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I.  OVERVIEW 
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B«  1983  Papers 

1*  Gevins?  A.S.?  Schaffer?  R.E.?  Doyle?  J.C.?  Cutillo?  B*A«? 
Tannehill?  R.L.  and  Bressler?  S.L.  Shadows  of  thoughts*  Rapidly 
changing?  asymmetric?  brain  potential  patterns  of  a  brief  visuomotor 
task.  Science?  1983?  220?  97-99. 

2.  Gevins?  A.S.  Brain  potentials  and  mental  functions* 
methodological  requirements.  In  I.  Alter  (Ed.)?  The  Limits  of 
Functional  Localization?  Raven  Press?  1983?  In  press. 

3.  Gevins?  A.S.  Brain  potential  evidence  for  lateralization  of 

higher  cognitive  functions.  In  J.B.  Hellige  (ed.)?  Cerebral 

Hemisphere  Asymmetry!  Method?  Theory  and  Application?  Praeger  Press? 
1983?  335-382. 

4.  Gevins?  A.S.  Brain  Potentials  and  Human  Higher  Cognitive 
Functions!  Methods?  research  and  future  directions.  In  J.  H.  Hannay 
(Ed.)?  Handbook  gf  Neuropsychology.  Oxford  Press?  1983?  In  press. 
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7*  Invited  Lecturer*  American  EEC  Society*  New  Orleans*  1983* 
D«  Exper ieents 

The  EE6SL  is  in  the  process  of  developing  the  eethod  of  Neurocognitive 
Pattern  (NCP)  Analysis  for  measuring  aspects  of  eass  neural  processes 
related  to  perceptuoeotor  and  cognitive  activities*  Several 
generations  of  NCP  Analysis  have  been  used  to  study  both  coeplex  and 
simple  tasks*  and  a  nueber  of  findings  have  emerged*  Taken  together* 
these  results  suggest  that  neither  strictly  localizationist  nor 
eguipotentialist  views  of  neurocognitive  functioning  are  realistic* 
Since  even  simple  tasks  are  associated  with  a  rapidly  shifting  mosaic 
of  focal  scalp-recorded  patterns*  neurocognitive  functioning  might  be 
better  modeled  as  a  network  in  which  the  activity  of  many  specialized 
local  processing  elements  is  periodically  integrated*  Our  research  is 
directed  toward  developing  methods  for  measuring  these  processes  more 
precisely  and  modeling  them  more  explicitly* 

N*B*  It  must  be  understood  that  scalp-recorded  potentials*  even 
unaveraged  timeseries*  are  not  necessarily  cortical  in  origin*  Until 
this  issue  is  settled*  it  is  essential  not  to  interpret  scalp 
designations*  which  conventionally  refer  to  underlying  cortical  areas* 
as  implying  measurement  of  the  activity  of  cortical  sources*  For 
convenience*  we  use  the  conventional  scalp  designations  subject  to 
this  caveat* 

Specific  findings  include* 

1*  Complex  perceptuoeotor  and  cognitive  activities  such  as 
reading  and  writing  have  unique*  spatially  differentiated  scalp  EEG 
spectral  patterns*  These  patterns  had  sufficient  specificity  to 
identify  the  type  of  task  from  the  EEG  (EEG  Clin*  Neurophvsiol » 
471693-703*  1979)*  The  results  were  in  accord  with  previous  reports 

of  hemispheric  lateralization  of  ‘spatial*  and  'linguistic* 
processing* 

2*  Nhen  tasks  are  controlled  for  stimulus*  response  and 
performance-related  factors*  complex  cognitive  activities  such  as 
arithmetic*  letter  substitution  and  mental  block  rotation  have 
identical*  spatially  diffuse  EEG  spectral  scalp  distributions* 
Compared  with  staring  at  a  dot*  such  tasks  had  approximately  10Z 
reductions  in  alpha  and  beta  band  spectral  intensities  (£££  Clin* 
Neurophvsiol*  471  704-710*  1979}  Science  2031665-668*  1979).  This 
reduction  may  be  an  index  of  their  task  workload*  Since  no  patterns 
of  hemispheric  lateralization  were  found*  this  study  suggested  that 
previous  reports  of  EEG  hemispheric  lateralization  may  have  confounded 
EEG  patterns  related  to  limb  and  eye  movements  and  arousal  with  those 
of  mental  activity  per  u  (Science  2071 1005-1008*  1980). 

3*  Split-second  visuomotor  tasks*  controlled  so  that  only  the 
type  of  judgment  varied*  are  associated  with  complex*  rapidly  shifting 
patterns  of  single-trial*  evoked  inter-electrode  correlation  of  brain 
potential  timeseries*  Differences  between  spatial  and  numeric 
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judgments  were  evident  in  the  task-cued  prestiaulus  interval.  Coaplex 
and  oftan  lataralizad  patterns  of  diffaranca  shifted  with  split-second 
rapidity  froa  stiaulus  onset  to  just  prior  to  response*  at  which  tiae 
there  was  no  difference  between  spatial  and  nuaeric  tasks  (Science 
2131918-922*  1981)*  This  suggested  that  once  task-specific 

differential  perceptual  and  cognitive  processing  was  coapleted*  a 
aotor  prograa  coaaon  to  both  tasks  was  executed*  regardless  of 
differences  in  the  stiauli  or  type  of  judgaent* 

4*  Rapidly  shifting*  focal  brain  potential  patterns* 
representing  the  aaxiaal  difference  between  siailar  split-second 
tasks*  can  be  extracted  with  NCR  Analysis*  The  aove  and  no-aove 
variants  of  a  split-second  visuospatial  judgaent  task*  which  differed 
slightly'  in  expectation*  differed  in  type  of  judgaent*  and  differed 
greatly  in  response*  were  associated  with  distinct  differences  in  the 
patterns  of  single-trial  evoked  correlation  between  scalp-recorded 
channels  (Science  220197-99*  19831  see  Sections  III  and  IV) «  These 
patterns  of  difference  increased  in  aagnitude  in  each  successive 
analysis  interval*  In  the  prestiaulus  interval*  correlations  of  the 
aidline  frontal  electrode  distinguished  the  tasks  (p<*01>*  In  the 
interval  spanning  the  Nl*  P2  and  N2  event-related  potential  (ERP) 
peaks*  the  between-task  evoked  correlation  contrast  was  focused  at  the 
aidline  parietal  electrode  (p<«001)»  In  the  interval  centered  on  the 
P3a  ERP  peak*  the  focus  of  correlation  difference  was  at  the  right 
parietal  electrode  and  involved  higher  correlation  of  the  right 
parietal  with  occipital  and  aidline  precentral  electrodes  in  the 
no-aove  task*  and  with  the  right  central  electrode  in  the  aove  task 
(p<5  x  10  a>.  In  an  interval  centered  135  asec  after  the  P3a  ERP 
peak*  which  included  right-handed  response  preparation  and  initiation* 
the  focus  of  contrast  shifted  to  the  left  central  electrode*  involving 
higher  correlation  with  aidline  frontal  and  occipital  electrodes  in 
the  aove  task  ang  with  the  aidline  parietal  electrode  in  the  no-aove 
task  p<5  x  10  “).  These  results  concur  with  neuropsychological 
aodels  of  these  tasks  derived  froa  clinical  observations*  They 
suggest  that  although  siaple  per ceptuoaotor  tasks  are  associated  with 
a  coaplex*  dynaaic  aosaic  of  brain  electrical  patterns*  it  is  possible 
to  isolate  foci  of  aaxiaal  differences  between  tasks*  It  is  clear 
that  without  a  split-second  teaporel  resolution  it  is  not  possible  to 
isolate  the  rapid  shift  in  lateralization  which  presuaably  is 
associated  with  perceptual-cognitive  and  efferent  processing  stages* 

5*  The  focal  patterns  of  evoked  correlation  derived  by  NCP 
Analysis  significantly  distinguished  the  single-trial  data  of  7  of  the 
9  people  in  the  above  study*  This  suggested  that  siailar 
neurocognitive  aechanisas  were  being  aeasured  across  the  aajority  of 
participants  (see  Section  IV) « 

6*  Beheviorally  identical  trials  of  the  aove  and  no-aove 
visuospatial  tasks  in  the  above  study  were  found  to  be  associated  with 
distinctly  different  brain  potential  patterns  (Section  V).  This 
suggests  that  appropriate  brain  potential  aeasures  aay  provide  a  tool 
for  aore  detailed  exaaination  of  previously  unaeasured  neurocognitive 
processes* 
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Neurocognitive  Pattern  (NCP)  Analysis  currently  consists  of  the 
application  of  an  adaptive-network?  nonlinear  eatheeatical  pattern 
classification  algorithe  to  extract  task-related  signals  froe  sets  of 
data*  The  analysis  is  applied  to  single-trial  tieeseries  in  brief 
tiee  windows  (100  to  175  esec)  for  up  to  49  scalp  electrodes*  The 
data  windows  are  detereined  for  each  person  froe  the  peaks  of  their 
averaged  ERPs  as  well  as  froe  stieulus  and  response  tieesr  but 
eeasures  are  Bade  on  single  trials* 

1*  Sieilar ities  and  Differences  Between  NCP  Analysis  and 
Conventional  ERP  Analysis 

NCP  Analysis  is  grounded  on  the  vast  body  of  inforeation  gained  froe 
ERP  eethods  and  has  the  saee  underlying  goal?  naeely  to  resolve 
spatially  and  teeporally  overlapping?  task-related  eass  neural 
processes*  However?  it  departs  in  several  ways  froe  the  currently 
popular  approach  of  extracting  independent  features  froe  averaged  ERPs 
by  principal  coeponents  analysis  (PCA)  followed  by  hypothesis  testing 
with  ANOVA.  First?  NCP  Analysis  is  concerned  with  spatioteepor al 
task-related  activity  recorded  by  eanv  electrodes  in  a  nueber  of  tiee 
intervals  froe  before  the  stieulus  through  the  response*  It 
quantifies  neurocognitive  activity  in  teres  of  a  variety  of 
paraeeters?  rather  than  aeplitude  and  latency  of  ERP  coeponents. 
Thus?  it  is  possible  that  the  increased  dieensionality  of 
paraeetrization  eay  facilitate  the  eeasureeent  of  subtler  aspects  of 
neurocognitive  processes*  Second?  the  questionable  assueption  of  a 
eultivariate  noreal  distribution  of  brain  potentials  is  not  Bade  in 
NCP  Analysis*  Third?  brain-potential  feature  extraction  and 
hypothesis  testing  are  perforeed  as  a  single  process  which  detereines 
features  which  are  eaxieally  different  between  the  conditions  of  an 
experieent?  rather  than  those  which  eeet  possibly  irrelevant  criteria 
such  as  statistical  independence*  Fourth?  task-related  patterns  of 
consistency  are  extracted  froe  sets  of  single-trial  data*  Significant 
results  eay  be  obtained  as  long  as  there  is  a  pattern  of  consistent 
difference  between  tasks?  even  though  the  eeans  of  the  two  data  sets 
do  not  differ  significantly. 

Taken  together?  these  aspects  of  NCP  Analysis  eay  enable  it  to  resolve 
seall  task-related  signals  froe  the  obscuring  background  'noise*  of 
the  brain?  revealing  useful  spatioteeporal  inforeation  about  eass 
neural  processes*  However?  this  is  not  without  its  costs*  NCP 
Analysis  requires  several  orders  of  eegnitude  eore  coeputing  than  PCA 
and  ANOVA?  and  larger  data  sets  than  conventional  ERP  studies*  Also? 
because  of  its  sensitivity?  highly  controlled  experieentel  paradiges 
are  required  to  assure  that  the  results  are  truly  related  to  the 
hypothesis  and  not  to  spurious  or  idiosyncratic  factors*  (The  process 
of  developing  one  such  task  is  described  in  Section  II  of  this 
report.)  This  requires  a  greater  allocation  of  effort  and  resources 
to  experieentel  design?  recording  and  analysis  than  is  needed  for  eost 
ERP  experieents* 

Although  we  have  obtained  several  proeising  results  with  NCP  Analysis? 

4 


August  2 »  1983  (34X06) 
the  latest  of  which  is  described  in  Sections  III  and  IV*  we  oust 
caution  that  'the  jury  is  still  out**  Additional  basic  studies  are 
needed  to  deteraine  whether  NCP  Analysis  is  really  worthwhile*  If  so* 
it  should  be  possible  to  optimize*  standardize  and  simplify  it  for  use 
in  other  laboratories* 

2*  Evoked  Correlations  Between  Scalp  Electrodes 

For  the  past  few  years  we  have  concentrated  on  a  measure  of  the  degree 
of  waveshape  similarity  (crosscorrelation)  between  timeseries  from 
pairs  of  electrodes*  Measures  of  single  channel  power  are  also  being 
used  and  preliminary  results  were  described  in  last  year's  Final 
Report*  The  crosscorrelation  approach  is  based  on  the  (unproven) 
hypothesis  that  when  areas  of  the  brain  are  functionally  related  there 
is  a  consistent  pattern  of  waveshape  similarity  between  them*  There 
are  a  number  of  considerations  in  interpreting  the  correlation 
patterns  of  scalp  recordings*  such  as  volume  conduction  from 
subcortical  sources  and  driving  by  distant  sources*  Some  of  the 
ambiguities  may  be  mitigated  by  careful  experimental  design*  but  the 
neurophysiological  interpretation  of  correlation  patterns  is  an 
unsettled  issue* 


Besides  the  scientific  value  of  studying  the  neural  activity 
associated  with  preparation  to  respond  and  the  subsequent  left  or 
right-handed  response  to  numeric  information*  the  bimanual  experiment 
described  in  this  Report  is  designed  to  provide  a  data  base  for 
refining  the  NCP  Analysis  and  investigating  some  aspects  of  the 
neurophysiological  interpretation  of  correlation  patterns*  In 
addition  to  inter-channel*  zero-lag  correlation*  NCP  Analysis  can 
employ  other  measures  such  as  multi-lagged  correlation  and  covariance* 
and  single  channel  power*  all  in  specific  frequency  bands* 
Preliminary  studies  described  in  last  year's  Final  Report  have 
revealed  significant  information  with  such  measures*  A  major  goal 
during  the  cooing  year  is  to  explore  and  resolve  some  of  these  issues* 
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II*  PiiQtiPfl  1 nd  Recording  q|  f  Bimanual  Perceptuoaotor  Study 
A*  Overview* 


He  arc  applying  a  naw  method*  called  Naurocognitiva  Pattern  (NCP) 
Analysis*  to  aaasura  spatial  naurocognitiva  electrical  processes  of 
the  huaan  brain  during  goal  directed  activities*  NCP  Analysis  has 
been  successfully  applied  in  four  studies'  and  results  so  far  are 
guite  promising*  An  area  of  particular  interest  is  neurocognitive 
changes  associated  with  learning*  In  considering  possible  experimental 
designs*  it  becaae  evident  that  the  concept  of  'learning*  is  fuzzy  and 
encoapasses  numerous  phenoaena*  Aniaal  aodels  were  found  to  be 
misleading  in  aajor  ways  because  of  the  coaputational  and  adaptive 
superiority  of  huaan  brains*  For  example*  several  years  ago  we 
piloted  a  study  which  atteapted  to  exaaine  learning  in  the  fora  of 
adaptation  to  changing  response  criteria  in  a  siaple  visuoaotor  task* 
He  found  that  people  were  able  to  adapt  too  quickly  to  the  changes  to 
provide  a  sufficient  data-base*  In  a  sense*  the  participants  quickly 
*autoaated*  the  process  of  adapting  to  changes*  A  aore  difficult 
perceptuoaotor  learning  paradiga  was  designed  and  implemented*  but  it 
suffered  froa  excessive  coaplexity*  Thus  even  if  they  were  aeasured' 
putative  neurocognitive  patterns  of  'learning*  could  not  be 
definitively  identified  with  perceptual'  cognitive  or  aotor  aspects  of 
the  task.  This  would  have  rendered  such  results  of  little  fundaaental 
interest.  Further  consideration  led  us  to  conclude  that  direct 
assaults  on  this  difficult  problea  aust  be  postponed  until  a  nuaber  of 
prerequisite  issues  were  addressed*  Before  subtle  aspects  of 
perceptuoaotor  and  cognitive  learning  could  be  aeaningfully  exaainedr 
it  was  necessary  to)  1)  further  refine  and  validate  our  new  aethod  of 
NCP  Analysis  on  data  froa  siapler  experiments)  2)  develop  effective 
digital  filters  for  eye  movement  (end  muscle  potential)  contaaination  of 
brain  potentials*  3)  iaprove  the  spatial  resolution  to  resolve 
patterns  over  inferior  and  superior  parietal  and  dorsolateral 
prefrontal  cortices  (this  would  require  at  least  49  recording 
electrodes)*  and  4)  aeasure  the  neurocognitive  patterns  associated 
with  preparation*  attention  and  'updating*  which  are  constituent 
processes  of  learning*  Accordingly*  it  seeaed  prudent  to  conduct  a 
preliainary  study  of  a  very  basic  issue!  a  comparison  of  the  patterns 
of  mass  neuroelectric  activity  associated  with  the  expectation* 
performance  and  'updating*  of  a  right  and  left-handed  visuomotor  task* 

He  have  designed  and  implemented  a  study  intended  to  delineate  the 
time-varying  foci  of  neuroelectric  activity  associated  with! 

1)  preparation  to  respond  with  either  the  left  or  right  hand  using  a 
hand-cued  paradigm) 

2)  performance*  with  right  and  left  hands*  of  a  brief*  difficult 
numeric  visuomotor  task)  and 

3)  'updating*  w'  en  pres*  <ted  with  feedback  about  the  accuracy  of  a 

response* 
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This  experiment  will  also  provide  s  high-quality  data-base  tor  further 
refinement  of  NCR  Analysis*  Studying  these  three  issues  will  require 
analyzing  brain  potentials  to  cue>  stimulus*  response  and  feedback. 
This  will  represent  an  expansion  of  the  temporal  extent  of  our 
analysis  from  about  one  second  to  six  seconds. 

B«  Task  Development . 

By  June  1*  1983*  six  full  pilot  recordings  and  17  preliminary 

screenings  were  conducted  using  a  cued  bimanual  numeric  judgment 
paradigm.  The  basic  task  was  the  numeric  visuomotor  judgment  task 
first  reported  in  Science*  21  August*  1981  (213*918-922).  It  involves 
the  execution  of  a  precise  contraction  of  the  index  finger  in  response 
to  visually  presented  single  digit  number  stimuli  on  a  linear  scale  of 
pressures  from  1  to  9 •  The  design  and  instrumentation  allow  a  high 
degree  of  control  over  stimulus*  response*  and  performance-related 
factors.  The  stimulus  is  preceded  by  a  cue  symbol  (V)  which  indicates 
the  responding  hand  by  the  direction  of  its  tilt*  either  to  the  right 
or  left.  The  stimulus  number  itself  is  also  tilted  in  the  direction  of 
the  hand  which  is  to  make  the  response*  and  the  participants  are 
instructed  to  attend  the  cue  so  that  appropriate  responses  could  be 
made  quickly  and  accurately  as  soon  as  the  stimulus  number  appeared 
(see  below). 

Feedback  indicating  the  exact  pressure  exerted  is  presented  one  second 
after  response  completion.  If  the  response  is  sufficiently  accurate* 
the  feedback  number  is  underlined*  indicating  a  'win*.  The  error 
tolerance  (ie.  degree  of  accuracy  required  for  a  win)  is  adaptive*  it 
is  computed  as  a  continuous  moving  average  of  the  actual  error  on  the 
proceeding  five  trials.  This  technique  equalizes  task  difficulty 
across  the  session*  and  also  serves  as  an  index  of  a  person's  current 
skill  level.  After  completion  of  each  block  of  17  trials*  a  display 
is  presented  showing  the  final  size  of  the  error  tolerance  and  the 
amount  of  bonus  money  won  on  that  block  (about  5  cents  for  each  win). 

The  electrode  montage  consisted  of  21  EEG  channels  (Fz*  aFl*  aF2*  F7* 
F8*  aCz*  Cz*  C3*  C4*  C5*  C6»  Rz*  P3»  P4»  aP5*  aP6»  T5*  T6*  Oz*  a01  and 
a02)  referenced  to  linked  mastoids  and  recorded  with  tin  alloy 
electrodes  affixed  to  a  specially  fabricated  nylon  mesh  cap 
(Electrocap  Int.).  Horizontal  and  vertical  EOG  were  recorded  with 
Ag-AgCl  electrodes*  as  was  the  EMG  activity  of  the  flexor  digitorua 
muscle  of  both  right  and  left  hands.  All  signals  were  lowpass  filtered 
at  100  Hz  and  digitized  at  256  Hz  by  the  RDR-15  computer  which  ran  the 
experiment. 

1.  Design  U  lEAIl* 

In  order  to  study  the  neuroelect' ic  patterns  associated  with 
preparation  to  execute  either  a  right  or  a  left-handed  response*  the 
design  must  allow  an  inference  of  the  existence  of  a  hand-specific 
preparatory  set  in  the  interval  between  the  cue  and  stimulus.  This 
was  done  with  a  miscuing  technique  wherein  a  randomly  ordered  201  of 
the  cues  are  invalid.  That  is*  the  responding  hand  indicated  by  the 
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stimulus  is  opposite  to  the  hand  indicated  by  the  cue*  A  person  is 
instructed  to  always  respond  with  the  hand  indicated  by  the  tilt  of 
the  stimulus  nuaber*  The  existance  of  a  hand-specific  preparatory  set 
is  then  inferred  by  the  'costs'  (lengthing  of  reaction  tiae  (RT)  and 
increase  in  error  rate)  in  the  aiscued  trials*  This  aethod  has  been 
used  to  infer  the  existance  of  aodality-specif ic*  position-specific 
and  task-specific  preparatory  sets  in  various  paradigas  (Posner* 
1978)*  and  in  our  laboratory  in  an  auditory-visual  biaodal  attention 
version  of  the  nuaeric  task  used  here* 

One  person  was  recorded  in  this  *aove-to-eiscues'  version  of  the 
biaanual  task  (total  403  trials*  cue-to-stiaulus  interval  =  1.5  sec)* 
and  substantial  'costs*  due  to  aiscueing  were  observed  (Table  1). 
Considered  together*  the  increase  in  average  response  tiae  in  aiscued 
right  and  left  handed  trials  was  68  asec*  a  12. 3%  lengthening  of  the 
average  RT  of  the  correctly  cued  trials*  The  error  rate  (proportion  of 
'lose*  trials)  increased  froa  56%  in  correctly  cued  trials  to  68%  in 
aiscued  trials. 

Average  stiaulus-registered  event-related  potentials  (ERPs)  showed  a 
30%  increase  in  aaplitude  of  the  P3  peak  in  the  aiscued  trials*  P3 
peak  latency  was  about  375  asec  in  all  correctly  and  incorrectly  cued 
conditions.  This  P3  enhanceaent  to  the  violation  of  the  cue-indicated 
expectancy  as  to  responding  hand  was  a  further  confiraation  of  the 
existance  of  a  hand-specific  preparatory  set  in  the  pre-stiaulus 
interval.  However*  Design  #1  was  deeaed  unsatisfactory  because 
attention  to  the  cue  could  not  be  confiraed  on  each  trial. 

2.  Design  #2  -  Hove/no-aove  (P's  #2-5) ♦ 

The  task  and  recording  aethods  were  the  saae*  except  that  a  person  was 
required  to  aake  qq  response  on  aiscued  trials*  (EHG  channels  on  each 
no-aove  trial  were  inspected  to  assure  that  no  flexion  or  extention 
aoveaents  were  aade.)  This  design  will  allow  a  'within  hand*  NCP 
Analysis  of  aove  and  no-aove  trials  to  delineate  the  foci  of 
post-stiaulus  processing  for  each  hand  seperately.  This  approach  was 
successfully  used  in  our  recent  study  of  a  visuospatial  task  (Science* 
1983*  220*97-99  —  see  Sections  III  and  IV)*  and  is  likely  to  aid  in 
interpreting  the  direct  NCP  Analysis  of  right  versus  left-handed  aove 
trials*  This  latter  point  is  particularly  iaportant*  since  we  do  not 
expect  the  neurocognitive  patterns  of  left-handed  responses  to  be 
aerely  airror  iaages  of  those  associated  with  right-handed  aoveaents 
(see  discussion  of  aoveaent-related  ERPs  below). 

Four  practiced*  right-handed  adults  perforaed  froa  355  to  1000  trials 
of  this  design  (total  2151  trials).  The  cue-to-stiaulus  interval  for 
P's  *2-4  was  1.5  sec*  and  for  P#5  it  was  1  sec.  Behavioral  data  for 
the  aove  (correctly  cued)  conditions  is  given  in  Table  2  (which 
includes  the  correctly  cued  trials  of  P#l)«  Average  response  tiaes* 
error  rate*  and  error  tolerance  (as  an  indication  of  skill  level)  were 
siailar  for  both  left  and  right-handed  trials.  Also*  the  standard 
deviations  of  response  tiaes  were  siailar  within  and  across  persons. 
Thus  perforaance-related  factors  were  equivalent  across  hands. 


8 


August  2 ?  1983  (34X06) 

C .  ERP  Description . 

1«  Stimulus  Related  Peaks ♦ 

In  NCP  Analysis?  average  ERPs  are  coaputed  for  each  person  seperately 
in  order  to  determine  the  onset  and  offset  tiaes  of  the  post-stiaulus 
analysis  intervals*  One  such  interval  will  be  centered  on  the  N1-P2 
peak  coaplex?  another  on  the  average  P3  peak  latency?  and  a  third  on 
the  aoveaent-r elated  potential  shift?  registered  retrograde  to  the 
aoveaent  onset  in  each  trial* 

The  stiaulus-registered  averages  of  P#4  are  shown  in  Figures  i  -4.  In 
all  persons  recorded?  the  N1  peak  was  largest  at  the  lateral  temporal 
sites  (T5  and  T6)?  saaller  at  the  lateral  occipitals  (aOl  and  a02)? 
and  for  P's  #3?  4  and  6  barely  visible  at  the  aidline  occipital 
placeaent  (Oz).  This  aay  have  been  due  to  the  saall  visual  angle  (<1 
degree)  subtended  by  the  stiauli?  in  which  case  the  presumed  cortical 
generators  for  foveated  stiauli  would  be  buried  in  the  calcarine 
fissure  and  project  tangentially  to  lateral  sites*  For  Pt5  the 
stiauli  were  doubled  in  size  and  their  line  thickness  increased? 
resulting  in  a  aore  robust  aidline  peak*  The  P2  peak  is  overlapped  by 
the  sharp  resolution  of  the  f ronto-centrally  doainant  cue-to-st iaulus 
CNV?  and  was  not  clearly  visible  in  aost  people  (see  next  section). 

The  P3  peak  was  visible  in  all  aove  and  no-aove  conditions  with  peak 
latencies  froa  320  to  550  asec.  Aaplitudes  were  larger  in  the  no-aove 
(aiscued)  conditions  for  all  persons?  and  the  duration  of  positivity 
was  longer.  Several  distinct  peaks  were  visible  as  late  as  750  asec. 

2*  Hoveaent  Related  Potentials  ♦ 

In  aove  trials  the  positive  peak  coaplex  was  followed  by  a 
negative-going  slow  potential  shift  (Figs*  1-4).  Hidline  distribution 
was  aaxiaal  at  f ronto-centr al  sites  (usually  aCz>?  and  of  nearly  equal 
aaplitude  in  right  and  left  hand  conditions.  Its  lateral  topography? 
however?  varied  between  hands*  For  right-handed  responses?  it 
exhibited  a  strong  left-sided  lateralization?  usually  aaxiaal  at  C3. 
For  left-handed  responses?  the  lateralization  did  not  reverse*  rather? 
it  exhibited  either  a  saaller  left-sided  lateralization  than 
right-handed  trials?  or  else  no  distinct  lateralization.  The 
response-registered  averages  (Figs  5  and  6)  show  a  siailar  pattern. 
(The  only  exception  to  this  was  in  P#2).  The  overall  picture  suggests 
that  left-handed  aoveaent-related  activity  is  not  aerely  a  airror 
iaage  of  right-handed  activity?  in  spite  of  the  equivalence  of 
response  and  perf oraance-related  factors  between  hands.  For  this 
reason  the  'within  hand*  NCP  coaparison  of  aove  versus  no-aove  trials 
will  be  a  prerequisite  step  in  analysis.  The  focal  patterns  of  neural 
activity  deterained  for  each  hand  seperately  will  aid  in  interpreting 
the  results  of  the  direct  NCP  coaparison  of  left  versus  right  hand 
conditions . 


3.  Cue-Related  Havefora 
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The  existence  of  a  cue-to-stieulus  contingent  negative  variation  (CNV) 
was  evident  in  the  f ronto-centr ally  dominant  displacement  of  the 
pre-stimulus  baseline  in  all  recordings*  CNV  activity  is  to  be 
expected  in  a  cued  paradigm  such  as  this?  and  may  well  be  an  integral 
part  of  the  process  of  task  preparation*  To  examine  the  effects  of  the 
cue-to-stimulus  interval  on  the  CNV?  and  the  effects  of  its  resolution 
on  the  post  stimulus  ERP  waveform?  one  person  was  recorded  (P*6>  in 
the  right  hand  condition  at  two  intervals*  In  the  first  run  the 
interval  was  2*5  sec  and  in  the  second  run  it  was  1  second*  The  sharp 
positive-going  CNV  resolution?  extending  from  125  to  165  msec 
post-stimulus  for  both  intervals?  was  larger  in  magnitude  for  the 
longer  (2*5  sec)  interval*  At  anterior  sites  it  partially  overlaped 
the  P234  peak*  Response  times  and  error  rates  were  equivalent  for  the 
two  intervals*  The  error  tolerance  for  the  shorter  interval  trials 
showed  an  improvement  in  performance  (which  may  have  been  due  to  a 
learning  effect)*  It  was  concluded  that  lengthening  the 
cue-to-stimulus  interval  will  not  reduce  the  effects  of  the  CNV  and 
its  resolution?  and  we  are  therefore  employing  the  shorter  (1  sec) 
interval  in  the  formal  recordings* 

D.  Final  Design* 

The  task  is  the  cued  bimanual  move/no-move  task?  with  a  1  sec 
cue-to-stimulus  interval*  Visual  stimuli  have  been  enlarged  to  just 
under  2  degrees  visual  angle  and  drawn  with  thicker  lines.  The 
electrode  montage  has  been  enlarged  to  26  channels  (Fz?  F3?  F4?  aFl? 
aF2?  aCz?  aC3?  aC4?  Cz?  C3?  C4?  C5?  C6?  aPl?  aP2?  aP5?  aP6?  Pz?  P3? 
P4?  T5?  T6?  Oz?  aOl?  a02  and  aOz)  referenced  to  aPz*  A  common  average 
reference  will  be  computed  off-line.  Signals  are  lowpass  filtered  at 
50  Hz  and  digitized  at  128  Hz*  Digitization  begins  *75  sec  before  the 
cue  and  extends  to  1  sec  after  onset  of  feedback*  Editing  for  artifact 
will  include  the  feedback  epoch  to  allow  an  analysis  of  neural 
patterns  such  as  those  accompanying  feedback  to  accurate  and 
inaccurate  trials.  The  main  analyses  will  be*  1)  move  vs.  no-move 
trials  for  right  and  left  hands  separately?  2)  right  hand  vs.  left 
hand  move  trials?  and  3)  the  cue-to-stimulus  interval  for  left-vs 
right  hand  cues. 

E*  Participant  Screening  Program . 

Twenty-three  candidate  participants  have  been  screened  to  date*  The 
screening  procedure  consists  of  200  practice  trials  and  200  test 
trials  of  the  bimanual  task*  The  test  trials  are  recorded  from  Fz?  Cz? 
Pz?  aOl  and  a02  (to  observe  the  post-stimulus  ERP  waveform)?  T1  and  T2 
(to  assess  amount  of  EHG  from  temporalis  muscles)?  and  diagonally 
placed  E0G  electrodes*  Eleven  candidates  who  were  unable  to  perform 
satisf actorally  were  excused  from  further  participation* 

F ♦  Formal  Recordings* 

Six  formal  test  recordings  have  been  completed  to  date?  using  the  26 
channel  EEC  montage  described  above*  About  900  trials  were  recorded 
from  each  person*  Trials  with  response  times  longer  than  1*25  sec? 
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poor  response  aoveaents*  and  no-eove  trials  on  which  a  response  is 
aade  are  autoaatically  rejected*  Data  attrition  due  to  these  sources* 
and  to  instruaental  and  eye-aoveaent  artifacts*  is  about  25Z*  Thus  we 
have  obtained  about  3600  useable  trials*  The  reaaining  data-base 
should  be  coapleted  with  the  recording  of  5  aore  persons* 


Table  1  "Costs"  In  response  time  and  error  rate  due  to  mlscueing  (miscues  random  20%;  10% 
right  hand,  10%  left  hand)  (P#4  -  MOSPI) 


Table  2  Reaction  times,  error  rate  (Lose  X),  and  average  error  tolerance  (as 
a  performance  Index  on  a  scale  of  1:100  units)  for  correctly  cued 
(move)  tlrals  (P’s  #1-5) 


Run  I Number 


Right 

hand 

TTT  (S.D.) 
msec 

Lose  X 

547 

(165) 

48 

617 

(190) 

54 

770 

(167) 

54 

795 

(182) 

57 

783 

(167) 

55 

773 

(144) 

52 

609 

(122) 

60 

673 

(80) 

54 

625 

(95) 

50 

625 

(142) 

54 

650 

(146) 

48 

669 

(136) 

49 

660 

(169) 

49 

Left  hand 


Lose  X  Error  Tolerance 


Tolerance 

9.0 

487 

(194) 

53 

6.2 

559 

(147) 

47 

7.8 

778 

(165) 

55 

10.4 

810 

(232) 

60 

11.7 

852 

(222) 

51 

6.4 

786 

(130) 

51 

13.8 

586 

(126) 

60 

10.7 

683 

(107) 

50 

13.8 

660 

(124) 

52 

8.7 

625 

(97) 

49 

8.1 

640 

(129) 

53 

12.4 

636 

(159) 

61 

9.8 

605 

52 

(170) 


(average 

5.B. 


Trials 


676  msec  52.6%  9.9  655  mse<  53. 3%  10.6 

(146)  (154) 


t  ti on.  Average  ERPs  from  H 4  (8C  trials,  .1  to  100  Hr  passband.) 
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Figure  4  a-  Left  hand  cued  no-move  condition  (3£  trials). 
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Shadows  of  Thought:  Shifting  Lateralization  <  Human 
Brain  Electrical  Patterns  During  Brief  Visuomotor  Task 

Abstract.  Dynamic  spatial  patterns  of  correlation  of  electrical  potentials  recorded 
from  the  human  brain  were  shown  in  diagrams  generated  by  mathematical  pattern 
recognition.  The  patterns  for  "move"  and  "no-move"  variants  of  a  brief  visuospa- 
tial  task  were  compared.  In  the  interval  spanning  the  P300  peak  of  the  evoked 
potential,  higher  correlations  of  the  right  parietal  electrode  with  occipital  and  central 
electrodes  distinguished  the  no-move  task  from  the  move  task.  In  the  next  interval, 
spanning  the  readiness  potential  in  the  move  task,  higher  correlations  of  the  left 
central  electrode  with  occipital  and  frontal  electrodes  characterized  the  move  task. 
These  results  conform  to  neuropsychological  expectations  of  localized  processing 
and  their  temporal  sequence.  The  rapid  change  in  the  side  and  site  of  localized 
processes  may  account  for  conflicting  reports  of  lateralization  in  studies  which 
lacked  adequate  spatial  and  temporal  resolution. 


Many  investigators  have  reported  that 
brain  activity  is  lateralized  during  cogni¬ 
tive  tasks.  Advanced  radiological  meth¬ 
ods  reveal  relative  localization  and  later¬ 
alization,  but  cannot  resolve  temporal 
sequencing  because  of  the  long  time  re¬ 
quired  for  observation.  Studies  of  on¬ 
going,  background  electrical  activity  do 
not  reveal  split-second  changes  in  neuro- 
cognitive  patterns,  and  those  that  have 
reported  lateralization  of  neurocognitive 
activity  have  been  questioned  on  meth¬ 
odological  grounds  (1-6).  Although  the 
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components  of  averaged  event-related 
potentials  (ERP's)  may  indicate  the  se¬ 
quencing  of  some  neurocognitive  pro¬ 
cesses,  they  have  not  revealed  consist¬ 
ent,  robust  signs  of  lateralization,  even 
for  language  (7).  Conclusions  derived 
from  patients  with  focal  brain  lesions  or 
with  "split-brains,"  cannot  be  directly 
extended  to  normal  subjects.  Lateralized 
processes  inferred  from  reaction  time 
differences  to  hemifieid  or  dichotic  stim¬ 
ulation  have  also  been  questioned  on 
methodological  grounds  (6).  These  fac¬ 


tors  have  undoubtedly  contributed  to 
conflicting  reports  of  lateralization  of 
brain  activity. 

To  observe  the  spatial  patterns  and 
sequencing,  of  neurocognitive  activity . 
we  have  developed  a  new  method  called 
neurocognitive  pattern  (NCP)  analysis. 
In  NCP  analysis  the  average  ERP's  of 
each  person  are  used  to  determine  the 
time  intervals  of  task-related  neural 
processes.  Within  these  intervals  the 
similarity  of  brain-potential  waveshapes 
over  the  scalp  is  measured  on  a  single- 
trial  basis  by  computing  the  cross-corre¬ 
lation  coefficient  between  paired  combi¬ 
nations  of  electrodes.  Although  the  neur- 
oanatomic  origin  and  neurophysiological 
significance  of  these  correlations  is  not 
known,  it  has  been  suggested  that  cogni¬ 
tive  activity  may  be  associated  with 
characteristic  scalp  correlation  patterns 
(9).  However,  task-related  electrical  sig¬ 
nals  from  the  brain  are  spatially  smeared 
in  transmission  to  the  scalp  and  are  em¬ 
bedded  in  background  activity.  Since 
linear  statistical  methods  were  not  effec¬ 
tive  in  dealing  with  these  obstacles,  we 
used  a  more  powerful  analysis  called 
trainable  classification-network  mathe¬ 
matical  pattern  recognition  (2.  3, 10-13). 
For  this  method,  artificial  intelligence 
algorithms  are  used  to  extract  patterns  of 
correlation  that  differ  between  two  con¬ 
ditions  with  no  assumptions  about  the 
distribution  of  correlation  values.  The 
algorithm  is  first  applied  to  a  labeled 
subset  of  the  experimental  data  called 
the  training  set,  and  the  invariant  pat¬ 
terns  (classification  functions)  found  are 
then  verified  on  a  separate  unlabeled 
subset  of  data  called  the  test  set.  If  the 
classification  functions  can  significantly 
separate  the  test  set  into  the  two  condi¬ 
tions,  the  extracted  patterns  have  intrin¬ 
sic  validity. 

Previously  we  reported  the  existence 
of  complex,  rapidly  changing  patterns 
of  brain-potential  correlation  involving 
many  areas  of  both  hemispheres  that 
distinguished  numeric  and  spatial  judg¬ 
ments  in  a  visuomotor  task  U3).  Since 
the  sequencing  of  neurocognitive  differ¬ 
ences  between  numeric  and  spatial  proc¬ 
essing  is  not  definitely  known,  the  com¬ 
plex  patterns  were  difficult  to  interpret. 
The  present  experiment  was  designed  to 
clarify  this  situation  by  highlighting  pre¬ 
sumably  localized  neural  processes.  In 
comparing  two  types  of  spatial  judg¬ 
ment,  the  common  activity  of  brain  areas 
should  cancel,  revealing  differences  in 
the  right  parietal  area  presumed  to  medi¬ 
ate  spatial  judgments.  The  right-handed 
finger  response  in  one  task  was  designed 
to  elicit  lateralized  activity  of  the  left 
central  motor  area. 
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In  this  study  a  person  estimated  the 
distance  a  “target"  should  be  moved  to 
intersect  a  displayed  arrow’s  trajectory. 
The  “move”  task  required  pressure  of 
the  right  index  finger  on  a  transducer 
with  a  force  proportional  to  that  distance 
(14).  In  the  “no-move”  task  the  arrow 
pointed  directly  at  the  target,  and  no 
pressing  was  required  (pseudorandom  20 
percent  of  trials).  Thus,  the  spatial  judg¬ 
ment  and  response  differed  between 
tasks,  while  gross  stimulus  characteris¬ 
tics  were  the  same. 

Nine  right-handed,  healthy  adults 
(eight  males,  one  female)  participated  in 
the  study.  The  average  response  initia¬ 
tion  (muscle  potential  onset)  time  for  the 
move  trials  was  0.59  second  (standard 
deviation,  0.19;  mean  of  standard  devi¬ 


ations  within  persons,  0.24).  Brain  po¬ 
tentials  were  recorded  from  15  scalp 
electrodes  and  referenced  to  linked  mas- 
totds  (Fig.  IA)  (IS).  Vertical  and  hori¬ 
zontal  eye  movements,  muscle  poten¬ 
tials  from  the  responding  finger,  and  the 
output  of  the  force  transducer  were  also 
recorded.  The  data  were  edited  to  re¬ 
move  trials  with  artifacts,  and  a  set  of 
1612  correct,  representative  trials  (839 
move,  773  no-move)  was  formed.  Aver¬ 
aged  ERP's  were  computed  for  all  elec¬ 
trodes  (Fig.  IB),  and  /-tests  and  analyses 
of  variance  (ANOVA’s)  were  performed 
U6.  17). 

Cross-correlations  were  computed  be¬ 
tween  91  paired  combinations  of  the  15 
electrodes  for  each  trial  in  each  of  three 
175-msec  intervals  (Fig.  IB).  Two  inter- 


Fig.  I .  (A)  Montage  of 
15  electrodes.  Non¬ 
standard  placements 
are  intended  to  over- 
lie  cortical  areas  of 
partiriitar  interest:  an¬ 
terior  occipital  <0y). 
anterior  parietal  (Ps). 
midline  precentral 
(superior  edge-Cr), 
and  midline  premotor 
( Csa I  areas.  (B)  Com¬ 
posite  average  event- 
related  potentials 

(ERP’s)  from  four 
persons  (75  percent  of 
the  total  data  from 
nine  persons)  for  the 
Pz  electrode,  showing 
the  major  ERP  peaks 
and  corresponding 
single  trial  correlation 
analysis  intervals. 

The  P300  ERP  peak  is 
larger  in  the  infre¬ 
quent  no-move  trials. 

(C)  One  of  the  15  sets  of  ten  electrode  pairs  into  which  the  91  paired  correlations  were  grouped. 
The  anterior  occipital  (Ov)  set  is  shown.  In  Fig.  2  the  principal  electrodes  of  differing  sets  art 
circled  and  the  most  prominent  correlations  are  indicated  as  solid  and  dotted  lines. 


•Save  («tO  trials) 


M,-n, 


N100-P200  Interval: 
149  to  324  msec 


P300  interval: 
302  to  477  msec 


RP  Interval: 
436  to  61 1  msec 


Fig.  2.  Diagrams  of  between-task  differences  in  the  (A)  NI00-P200,  (B)  P300.  and  (C)  RP 
intervals  generated  by  neurocognitive  pattern  (NCP)  analysis.  The  most  significantly  differing 
electrode  sets,  their  significance  level,  and  the  most  prominent  correlations  within  the  set  are 
shown.  A  solid  line  between  two  electrodes  indicates  that  the  correlations  were  higher  in  the 
move  task,  while  a  dotted  line  indicates  higher  no-move  task  correlations. 
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vals  spanned  the  NI00-P200  and  P300 
ERP  peaks,  and  the  third  (RP)  interval 
spanned  most  of  the  readiness  potential 
(in  the  move  task).  The  centerpoint  of 
each  interval  was  determined  for  each 
person  (18).  The  correlations  were  stan¬ 
dardized  within  persons,  within  elec¬ 
trode  pairs  (mean,  0;  standard  deviation. 
I),  and  then  grouped  across  people.  The 
/-tests  and  ANOVA’s  of  single-trial  cor¬ 
relations  did  not  distinguish  meaningful 
differences  in  between-task  spatiotempo- 
ral  patterns. 

Mathematical  pattern  classification 
was  then  applied  to  the  single-trial  corre¬ 
lations  of  all  nine  people  to  search  for 
subtle  between-task  differences  in  each 
interval.  To  make  the  results  anatomical¬ 
ly  interpretable,  we  performed  the 
search  separately  on  each  of  15  sets  of 
electrode  pairs.  Each  set  consisted  of  the 
correlations  of  a  particular  electrode 
with  ten  other  electrodes  (Fig.  1C).  For 
each  interval,  the  electrode  set  that  dis¬ 
tinguished  conditions  on  the  test  set  with 
the  highest  significance  level  (19).  and 
the  most  prominent  correlations  for  that 
electrode  set  (20),  were  diagramed. 

In  the  N100-P200  interval,  correla¬ 
tions  of  the  midline  parietal  electrode 
distinguished  the  tasks  (P  <  .001)  (Fig. 
2A).  In  the  P300  interval,  correlations  of 
the  right  parietal  electrode  with  the  mid¬ 
line  occipital  and  precentral  electrodes 
were  greater  in  the  no-move  task,  while 
correlations  of  the  right  parietal  with  the 
right  central  electrode  were  greater  in 
the  move  task  (P  <  5  x  10“')  (Fig.  2B). 
In  the  RP  interval,  correlations  of  the  left 
central  electrode  with  the  midline  frontal 
and  occipital  electrodes  were  greater  in 
the  move  task,  while  correlations  of  the 
left  central  electrode  with  the  midline 
parietal  electrode  were  greater  in  the  no¬ 
move  task  (P  <  5  x  10"‘)  (Fig.  20. 

The  right  parietal  locus  of  between- 
task  difference  in  the  P300  interval  may 
reflect  a  lateralization  of  activity  distin¬ 
guishing  the  two  types  of  spatial  judg¬ 
ment  (21)  or  the  difference  between 
movement  estimation  in  the  move  task 
and  the  cancellation  of  response  in  the 
no-move  task.  The  left  central  focus  of 
difference  in  the  RP  interval  135  msec 
later  may  reflect  the  preparation  and 
initiation  of  the  movement  of  the  right 
index  finger.  In  contrast,  the  pattern  of 
difference  in  the  N100-P200  interval  was 
not  lateralized. 

These  results  may  help  explain  con¬ 
flicting  reports  of  brain-potential  laterali¬ 
zation.  In  many  studies,  various  "ver- 
bal-analytic"  and  “spatial"  tasks  I  min¬ 
ute  or  more  in  duration  have  been  associ¬ 
ated  with  relative  left  and  right  hemi¬ 
sphere  EEG  activity  (1-6).  However,  it 
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is  not  clear  whether  this  activity  is  asso¬ 
ciated  with  mental  aspects  of  tasks  or 
with  sensorimotor  components,  or  with 
artifacts.  In  a  previous  study  we  found 
no  topographic  differences  in  EEG  spec¬ 
tra  between  13-second  arithmetic,  block 
rotation  and  letter  substitution  tasks  af¬ 
ter  rigorously  controlling  other-than -cog¬ 
nitive  factors  (2-4).  However,  such  het¬ 
erogeneous  tasks  cannot  be  resolved  into 
serial  components  reflecting  different 
neurocognitive  processes.  We  therefore 
refined  our  approach  by  using  short  (less 
than  1  second)  tasks,  using  time  refer¬ 
ences  based  on  person-specific  average 
ERP  measurements,  computing  correla¬ 
tions  between  channels  on  a  single-trial 
basis,  and  using  mathematical  pattern 
classification  to  reveal  split-second  se¬ 
quential  processing.  This  yielded  a  se¬ 
quence  of  clear-cut  between-task  differ¬ 
ence  patterns  involving  split-second 
changes  in  the  localization  and  lateraliza¬ 
tion  of  mass  neural  activity.  Appropriate 
studies  of  neurocognitive  functions 
should  take  into  account  this  rapidly 
shifting  network  of  localized  and  later- 
alized  processes. 
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BOTE  18a.  The  average  ERP  unvefoma  (Figure  1»)  contain  aeveral  late  positive  peaks. 
P391  and  P530  are  larger  in  amplitude  in  the  infrequent  no-nove  trials,  while 
P425  is  larger  in  the  frequent  nove  tirala.  The  P300  analysis  interval  was  centered 
on  P391,  the  earliest  positive  peak  to  show  a  sigr  fiesnt  between-task  difference 
aaxlaal  at  the  anterior  nidi ine  parietal  electrode  (p<-0005).  Since  P391  and  P530 
were  larger  in  the  infrequent  no  nove  triala,  and  *391  followed  a  negative  difference 
ERP  peak  (K2)  at  240  nsec,  P391  and  P530  could  be  designated  P3a  and  P3b  according 
to  the  convention  of  Squires,  et  al  (Electroenceph.  Clin.  Beurophyalol ■  38:387-401, 
1973).  The  P300  interval  night  then  be  specified  as  the  P3a  interval”,  as  In  our 
previous  etudy  of  siallar  tasks  (Gevins,  et  al.  Science.  213:918-922,  1981).  The 
response  preparation  (RP)  interval,  centered  135  nsec  after  the  P300  interval,  also 
spans  the  P530  peak  of  the  no-nove  trials. 
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ABSTRACT 


Spatial  patterns  of  single-trial  evoked  correlations  of  human 
scalp-recorded  brain  potentials  were  determined  by  applying 
Neurocognitive  Pattern  <NCP)  analysis  to  data  from  nine  adults 
performing  a  visuospatial  task.  Mathematical  pattern  recognition  was 
used  to  determine  the  differences  in  the  spatial  patterns  of 
correlation  of  'move1  and  'no-move '  trials  in  successive  175-msec 
intervals.  The  magnitude  of  the  patterns  of  difference  between  tasks 
increased  in  each  successive  interval.  In  the  prestimulus  interval* 
correlation  of  the  midline  frontal  electrode  with  lateral  central  and 
left  temporal  electrodes  was  greater  for  the  no-move  task*  while  its 
correlation  with  the  left  parietal  electrode  was  greater  for  the  move 
task  (p<«01)«  In  the  interval  spanning  the  Nl*  P2  and  N2 
event-related  potential  (ERP)  peaks*  the  between-task  contrast  was 
focused  at  the  midline  parietal  electrode  and  involved  higher 
correlation  of  that  electrode  with  lateral  temporal  and  midline 
precentral  electrodes  in  the  move  task  *  and  with  the  left  frontal 
(F7)  electrode  in  the  no-move  task  (p<.001>.  In  the  interval 
centered  on  the  P3a  peak*  the  focus  of  correlation  difference  was  at 
the  right  parietal  electrode  and  involved  higher  correlation  of  the 
right  parietal  with  occipital  and  midline  precentral  electrodes  in 
the  no-move_>ask»  and  with  the  right  central  electrode  in  the  move 
task  <p<5xl0  J).  In  the  interval  centered  135  msec  after  the  P3a  ERP 
peak*  and  which  included  the  right-handed  response  preparation  and 
initiation*  the  major  focus  of  contrast  shifted  to  the  left  central 
electrode*  involving  higher  correlation  of  that  electrode  with 
midline  frontal  and  occipital  electrodes  in  the  move  task.*_gnd  with 
the  midline  parietal  electrode  in  the  no-move  task  <p<5xl0  ).  In 

seven  of  the  nine  participants*  the  group  equations  significantly 
distinguished  the  tasks.  Move  and  no-move  trials  which  were 
behaviorally  correct*  but  which  were  misclassif ied  by  the  algorithm 
showed  high  prestimulus  alpha  activity  in  the  averages*  and  had 
post-stimulus  waveform  morphologies  intermediate  between  correctly 
classified  move  and  no-move  types.  Although  the  neurophysiological 
significance  of  these  patterns  of  evoked  correlation  is  unknown*  the 
results  are  consistent  with  the  observation  in  humans  and  primates 
that  simple  visuospatial  tasks  involve  the  integration  of 
spatially-distributed  activity  in  many  neural  areas. 


Neurocognitive  Pattern  (NCR)  analysis  is  a  method  of  Measuring  the 
functional  topography  of  human  scalp-recorded  brain  potentials  during 
goal  directed  activity*  It  involves  application  of  mathematical 
pattern  recognition  to  measures  of  inter-electrode  correlations  of 
single-trial  evoked  brain  potentials*  Here  we  report  the  measurement 
of  rapidly  shifting*  focal  patterns  of  correlation  which  distinguish 
two  variants  of  a  brief  *move/no-move*  visuospatial  task* 

It  has  been  proposed  that  task-specific  neural  processes  manifest 
patterns  of  waveshape  similarity  (crosscorrelation)  of  low-frequency 
macropoteritials  (Dumenko*  1970*  Livanov*  1977)*  A  number  of  studies 
have  approached  this  issue  with  scalp-recorded  EEGs  (Walter  and 
Shipton*  1951*  Brazier  and  Casby*  1952*  Callaway  and  Harris*  1974* 
Busk  and  Galbraith*  1975*  Livanov*  1977)*  but  this  hypothesis  remains 
unproven  due  to  problems  of  experimental  design  and  lack  of 
methodology  for  precise  measurement  of  task-related  correlation 
patterns  at  the  scalp. 

Any  test  of  the  hypothesis  that  waveshape  similarity  among 
scalp-recorded  brain  potentials  reflects  task-related  processing  in 
underlying  neural  populations  must  meet  several  methodological 
criteria.  First*  the  functional  relationships  of  specific  areas  must 
be  explicitly  manipulated.  Well  established  ■landmarks*  such  as 
sensory*  'association*  and  motor  areas  must  be  used  as  anatomic 
reference  points  in  the  experimental  design*  and  the  scalp 
projections  of  the  presumed  generators  must  be  considered.  Second* 
the  experiment  must  be  rigorously  controlled  for  stimulus*  cognitive* 
performance  and  response-related  factors  to  allow  unambiguous 
association  of  experimental  manipulations  with  spat iotempor al 
electrical  patterns.  Third*  a  high  degree  of  temporal  resolution  is 
required*  since  the  neural  processes  involved  in  brief  cognitive 
tasks  last  only  a  fraction  of  a  second.  Fourth*  measures  must  be 
made  on  single-trial  EEG  timeseries  rather  than  averages*  since  the 
exact  timing  of  neurocogniti ve  processes  may  vary  from  trial  to 
trial.  Fifth*  the  analytic  method  must  be  able  to  extract  small 
task-related  signals  from  the  obscuring  effects  of  background 
activity  and  volume  conduction. 

Our  first  study  employing  NCP  analysis  (Gevins*  et  al*  1981)  revealed 
complex*  rapidly  changing  patterns  of  evoked  correlation  which 
involved  many  areas  of  both  hemispheres  which  differed  between 
numeric  and  spatial  judgments  performed  on  equivalent  stimuli. 
However*  the  complex  patterns  were  difficult  to  interpret  since  the 
sequencing  of  neur ocogni ti ve  activity  in  numeric  and  spatial 
judgments  is  not  definitively  known.  The  present  study  was  designed 
to  clarify  this  situation  by  highlighting  presumably  localized  neural 
processes.  In  comparing  the  move  and  no-move  variants  of  a  spatial 
judgment  task  the  common  activity  of  brain  areas  should  cancel* 
revealing  focal  differences  in  visual  and  parietal  areas  presumed  to 
mediate  visual  discrimination  and  spatial  judgments.  The 
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right-handed  response  in  the  '»ove*  task  should  elicit  lateralized 
activity  of  the  left  central  motor  area. 

METHODS 


Tasks  and  Protocol 

The  participant  <P)  was  seated  in  an  acoustically  dampened  recording 
chamber  with  ri3ht-hand  index  finger  resting  on  a  force  transducer. 
Stimuli  were  presented  on  a  Tektronix  graphics  terminal  and  subtended 
a  visual  angle  of  less  than  2  degrees  horizontally  and  vertically. 
They  consisted  of  an  arrow  originating  at  center  screen  and  a 
vertical  line  segment  (the  'target*)  to  one  side  (Fig.  1).  The 
target's  vertical  position  and  side  of  screen  changed  randomly  across 
both  move  and  no-move  trials*  as  did  the  angle  and  direction  of  the 
arrow .  The  arrow's  angle  varied  from  0  to  30  degrees  from  the 
horizontal*  and  target  size  ranged  from  2  to  36  mm  (see  below). 
Stimuli  remained  on  the  screen  until  feedback  was  presented.  On  move 
trials  the  participant  was  to  estimate  the  distance  the  target  must 
be  moved  so  that  the  arrow's  trajectory  would  intersect  its  center* 
and  apply  a  pressure  proportional  to  that  distance  with  a  ballistic 
contraction  of  the  right  index  finger.  Responses  were  made  on  a 
Grass  isometric  force  transducer  with  maximum  1mm  travel  at  a  force 
rate  of  1  kg/mm.  The  required  force  varied  randomly  from  . 1  to  1  kg. 
On  “no-move*  trials  the  arrow  and  target  were  oriented  so  that  the 
arrow's  trajectory  would  intersect  the  center  of  the  target*  and  no 
movement  was  to  be  made  (Fig.  1). 

Trials  occurred  in  blocks  of  13  or  17.  The  blocks  were 
self-initiated  by  the  participant  and  lasted  about  1.5  min.  The 
no-move  trials  constituted  20%  of  the  total  number  of  trials  and  were 
presented  in  semi-random  order  such  that  the  first  two  trials  of  a 
block  were  always  move  trials*  and  a  no-move  trial  was  always 
followed  by  a  move  trial.  Each  trial  consisted  of  a  warning  symbol 
followed  after  2  sec  by  the  stimulus.  One  second  after  completion  of 
response  in  the  move  task*  feedback  indicating  the  response  pressure 
was  presented  for  1  sec.  Feedback  for  no-move  trials  was  presented 
3.5  sec.  post-stimulus .  The  inter-trial  interval  was  1.8  sec. 

Two  factors  were  included  to  reduce  the  automatization  of  task 
performance.  First*  at  the  start  of  each  block  of  trials  the  gain  of 
the  response  transducer  was  switched  between  2  levels  of  sensitivity* 
requiring  the  participant  to  adjust  his  responses  between  2 
pressure/distance  scales.  Second*  the  target  automatically  shrank  or 
lengthened  (from  2  to  36  mm)  for  both  move  and  no-move  trials  as  an 
on-line  function  of  accuracy  in  the  previous  5  move  trials.  Thus  task 
difficulty  was  continually  adjusted  to  match  each  person's  current 
performance  level. 

Nine  right-handed  adults  (8M»  IF)  were  recorded.  The  first  five  were 
healthy  students  and  professionals*  ages  20  to  35*  who  received  about 
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50  practice  trials  before  performing  the  tasks  during  2.5  hour 
recording  sessions ♦  The  last  four  were  highly  skilled  aircraft 
pilots  who  had  several  hundred  practice  trials  and  who  performed  a 
large  number  of  trials  in  6  hour  recording  sessions. 

Brain  potentials  were  recorded  from  15  scalp  electrodes  and 
referenced  to  linked  mastoids  <Fig.  2a).  The  montage  included 
several  non-standard  midline  placements  intended  to  overlie  cortical 
areas  of  particular  interest:  *a0z*  (anterior  occipital)*  'aPz* 
(anterior  parietal)*  *aCz*  (precentral)*  and  *pFz*  (anterior  motor). 
The  first  five  Ps'  brain  potentials  were  amplified  by  two  Beckman 
Accutraces  with  .16  to  50  Hz  passband*  for  the  other  four  a 
Bioelectric  Systems  Model  AS-64P  amplifier  with  .10  to  50  Hz  passband 
was  useei.  Vertical  and  horizontal  eye-movement  potentials 
(electrodes  at  outer  canthi  and  above  and  below  one  orbit)* 
response-muscle  potentials  ( flexor  digitorum) *  and  response 
transducer  output  were  amplified  by  a  Grass  Model  6  with  .30  to  70  Hz 
passband.  All  signals  were  low-pass  filtered  at  50  Hz  (40  dB/octave 
rolloff)  and  digitized  to  11  bits  at  126  samples/sec . 

Software  System 

The  ADIEEG*  integrated  software  system*  was  used  for  all  aspects  of 
the  experiment  (Gevins  and  Yeager*  1972*  Gevins*  et  al*  1975*  1979a* 
1981*  1983b).  This  system  performs  real-time  control  of  experiments 
and  behavioral  and  physiological  data  collection*  allows  automatic 
on-line  modification  of  experimental  parameters  as  a  function  of  task 
performance*  has  a  flexible  database  structure  and  integrated  data 
path  for  the  recording  and  analysis  of  up  to  56  physiological 
channels*  allows  selection  and  control  of  the  stimulus*  response  and 
performance-related  variables  used  to  aggregate  trials  into  data 
sets*  performs  digital  filtering  and  timeseries  analysis  of  EEGs  and 
ERPs*  and  tests  hypotheses  with  linear  univariate  and  multivariate 
analyses  and  mathematical  pattern  recognition. 


Formation  of  Data  Sets 

Polygraph  records  were  edited  off-line  to  eliminate  trials  with 
evidence  of  eye  movement  in  the  E0G  channels*  or  muscle  or 
instrumental  artifacts  in  the  EEG  channels*  from  0.5  sec  before  the 
stimulus  to  0.5  sec  after  response  initiation .  The  total  set  of  1612 
trials  (839  move*  773  no-move)  submitted  to  analysis  consisted  of  69 
to  350  behaviorally  correct  trials  from  each  of  the  9  participants 
(Table  1).  Correct  move  trials  were  those  in  which  the  participant's 
response  was  ballistic*  was  completed  by  1.5  sec  after  stimulus 
onset*  and  was  not  greatly  'off  target*.  Correc*  no-move  trials 
were  those  in  which  no  EMG  was  evident  in  response  to  the  •no-move* 
stimulus  configurations.  There  was  no  difference  between  the  two  data 
sets  in  the  stimulus  parameters  of  arrow  angle  and  side  of  screen  of 
the  arrow  and  target*  since  these  parameters  were  randomized  by  the 
program.  Target  size  was  balanced  between  move  and  no-move  trials. 
The  set  of  move  trials  had  representative  distributions  of  response 
variables  including  response  initiation  time*  accuracy*  pressure* 
duration*  and  velocity.  Response  initiation  was  determined  by  the 


beginning  of  the  average  EMG  burst  of  the  right  index  finger's  flexor 
digitor  urn »  Thus  Hiove  and  no-move  tasks  differed  slightly  in 
expectancy  and  stimulus  conf igur ation*  differed  in  the  decision  based 
on  spatial  judgment*  and  differed  greatly  in  type  and  difficulty  of 
response . 


Average  ERPs 


Average  ERF's  for  all  channels  were  computed  for  each  person  in  order 
to  determine  centerpoints  of  time  intervals  for  NCR  analysis. 
Amplitudes  of  the  major  ERF*  peaks  were  measured  from  a  500- msec 
prestimulus  baseline.  N1  was  the  first  major  negative  deflection* 
maximal  posteriorly.  F'2  was  the  immediately  succeeding  positive 
deflection*  maximal  at  the  anterior  parietal  electrode.  F'3a  and  F'3b 
were  the  first  and  second  positive  peaks  enhanced  in  the  infrequent 
no-move  task  and  maximal  at  parietal  electrodes.  The  immediately 
succeeding  negative  potential  shift  (in  the  move  trials)  was  measured 
as  the  slope  of  a  straight  line  fitted  to  the  ERR  in  the  175-msec 
interval  centered  135  msec  after  the  F‘3a  peak. 


Single  Evoked  Trial  Correlations 


After  applying  a  phase-preserving*  nonrecursive  digital  lowpass 
filter  ( 3  dB  amplitude  point  at  12  Hz  >  to  the  single-trial 
timeseries*  crosscorrelations  between  pairs  of  electrodes  were 
computed  according  to  the  formula! 
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where  X  and  Y  are  the  sampled  voltages  of  channels  x  and  y  at  N  time 
points*  and  sw>  s  their  standard  deviations.  A  Fisher’s  z' 
transformation  '‘was  *then  applied  to  each  correlation  value. 
Correlations  were  computed  for  each  of  the  1612  trials  in  each  of  4 
analysis  intervals  for  91  of  the  105  possible  pairwise  combinations 
of  electrodes  (Fig.  2b).  14  pairs  which  were  non-homologous  or 

closely  spaced  were  excluded  due  to  computational  limitations. 

Since  the  major  ERR  peaks  indicate  the  average  latencies  of  distinct 
task-related  processes*  the  centerpoint  locations  of  three  of  the 
four  175  msec  analysis  intervals  were  determined  from  the  peak 
latencies  of  the  average  ERR  (Fig.  3).  This  was  done  separately  for 
each  person  to  account  for  individual  variations.  The  first  interval 
was  the  175  msec  epoch  preceding  the  stimulus.  The  second  interval 
stradled  each  person's  N1-P2  peak  complex*  and  the  third  was  centered 
on  the  P3a  peak*  which  was  the  first  positive  peak  to  show  a  between 
task  difference.  The  fourth  interval  was  centered  135  msec  after  the 
R3a  peak  and  spanned  a  portion  of  the  response  preparation  (RR)  in 
the  move  trials  and  the  P3b  peak  in  the  no-move  trials.  (An  NCR 
analysis  synchronized  to  the  movement  onset  will  be  reported 

elsewhere) . 


To  equalize  the  scale  of  correlation  values  across  people*  the  Fisher 
z ' -transformed  correlations  were  converted  to  standard  scores  within 
each  person's  data  in  each  interval  (x  =  0*  s  =  l)  and  then  grouped 
across  people.  ANOVAs  and  t-tests  were  performed  on  the  single-trial 
correlations  to  determine  task-related  differences  observable  by 
linear  statistical  methods. 

Use  of  Mathematical  Pattern  Recognition  for  Spat i otempor a  1  Analysis 


The  analysis  of  between-task  differences  in  spatial  patterns  of 
evoked  correlation  was  performed  with  nonlinear* 

distribution- independent*  trainable  classification -network 

mathematical  pattern  recognition  (Viglione*  1970*  Gevins*  1980* 
Gevins*  et  al»  1979a*  1981*  1983ab>.  This  method  is  similar  in 
purpose  to  stepwise  discriminant  analysis*  but  uses  a  more 
sophisticated  algorithm  to  search  for  combinations  of  variables  which 
distinguish  the  data  of  two  conditions  of  an  experiment.  The  search 
is  conducted  on  a  task-labeled  portion  of  the  data*  called  the 
training  set*  and  then  the  extracted  patterns  of  difference 
(classification  equations)  are  verified  on  the  remaining  unlabeled 
data*  called  the  test  set.  If  these  classification  equations  can 
significantly  divide  the  test  set  into  the  two  conditions*  the 
extracted  patterns  can  be  said  to  have  intrinsic  validity. 

To  avoid  spurious  results*  the  sensitivity  of  this  method  requires 
that  the  experimental  conditions  be  highly  balanced  for  all  factors 
not  related  to  the  intended  manipulations  (Gevins  and  Schaffer*  1980* 
Gevins*  et  al*  1980*  1983b*  Gevins  1980*  1983ab)»  and  that  the  ratio 
of  observations  to  variables  be  on  the  order  of  20  to  1  or  more.  The 
variables  submitted  to  analysis  should  be  grouped  (constrained) 
according  to  neuroanatomical  and  neurophysiological  criteria  so  that 
inter  pretable  results  may  be  obtained  (Gevins*  et  al*  1979ac*  1981* 
1983ab*  Gevins  1980).  In  this  study  temporal  constraints  consisted 
of  locating  the  analysis  intervals  according  to  the  major  peaks  of 
each  person's  average  ERP.  Anatomical  constraints  were  applied  by 
forming  sets  consisting  of  the  correlations  of  each  of  the  15  scalp 
electrodes  (called  a  principal  electrode)  with  10  other  electrodes 
(Fig.  2c).  (To  reduce  the  amount  of  computation*  A  of  the  14 
possible  pairings  were  excluded  from  each  set.  These  involved 
electrodes  adjacent  to  the  principal  electrode*  or  pairings  nearly 
redundant  with  others.)  Midline  sets  were  symmetrical*  and  lateral 
sets  were  mirror  images  of  each  other. 


Classification  equations .  A  separate  classification  equation  was 

computed  for  each  of  the  15  electrode  sets  in  each  analysis  interval 
for  each  task-labeled  training  set.  Each  classification  equation 
consisted  of  a  linear  combination  of  the  binary  decisions  of  1  to  6 
discriminant  functions.  Each  discriminant  function  consisted  of  a 
linear  combination  of  6  correlations  selected  by  the  algorithm  from 
the  10  electrode-pair  correlations  of  an  electrode  set. 


A  recursive  procedure  was  used  to  develop  each  classification 
equation*  First»  15  discriminant  functions  were  computed  (this 
number  was  set  by  computer  limitations) *  and  the  best  was  retained  as 
a  binary  output  (move  or  no-move)  times  a  coefficient  wei3hted  for 
optimum  classification  performance  by  minimization  of  an  exponential 
loss  function*  This  process  was  repeated  6  times?  the  best 
discriminant  function  from  each  new  set  of  15  was  added  to  the 
evolving  classification  equation*  and  the  weights  assigned  to  each 
were  updated.  After  each  pass*  the  training  data  were  re-weighted 
inversely  to  the  classification  effectiveness  of  the  classification 
equation*  so  that  the  next  pass  would  concentrate  on  the  incorrectly 
classified  data.  In  this  way  a  classification  equation  which 
optimally  partitioned  the  training  data  set  into  move  and  no- move 
tasks  was  formed. 

Training  and  testing  (validation)  data  sets .  The  data  set  of  1612 
trials  was  partitioned  into  3  non-overlapping  test  (validation)  sets. 
For  each  test  set*  the  remaining  two-thirds  of  the  data  served  as  its 
training  set.  This  rotation  of  training  and  testing  sets  reduced 
sampling  error  due  to  test-set  selection. 

A  separate  classification  equation  was  formed  using  each  of  the  3 
training  sets.  Then  the  classification  accuracy  of  each  of  the  3 
equations  for  each  interval  was  measured  on  its  corresponding  test 
set*  and  the  average  test-set  classification  accuracy  was  determined. 

Significance  levels  of  classification ♦  Since  our  aim  was  to 

determine  task-related  spatiotempor al  patterns*  rather  than  to 
predict'  behavior*  the  analysis  was  constrained  to  facilitate  a 
neuroan atomically  and  neur ophys iological ly  meaningful  interpretation. 
Thus  classification  accuracies  were  not  as  high  as  they  would  have 
been  without  constraints.  To  determine  the  significance  levels  of  the 
classification  accuracies  it  was  necessary  to  determine  a  baseline 
significance  level  and  safeguard  against  a  Type  1  error.  To  do  this* 
equations  were  formed  from  sets  of  randomly  task-labeled  data  for 
each  analysis  interval.  The  average  classification  accuracy  of  48 
such  random-labeled  studies  was  50.6%*  with  a  standard  deviation  of 
1.1%.  This  could  have  occurred  by  chance  with  p=.32*  according  to  the 
normal-curve  approximation  to  the  binomial  distribution.  Actual 
test-set  classification  accuracies  of,-52.9%*  53.9%*_^4.9%  and  55.5% 
correspond  to  p<.01»  p<.001»  p<5  x  10  J  and  p<5  x  10  ,  respectively. 

These  significance  levels  were  used  as  an  index  of  the  relative 
consistency  of  differences  between  move  and  no-move  tasks. 

Diagrams  £f  classification  equations .  In  order  to  illustrate  the 
strongest  between-task  differences*  diagrams  were  drawn  showing  the 
principal  electrode  and  the  electrode  pairings  which  contributed  most 
to  the  classification  function  for  the  most  significant  electrode  set 
in  each  interval.  These  •prominent*  evoked  correlations  were 
determined  by  applying  the  pattern  recognition  procedure  recursively 
to  the  most  significant  electrode  set.  Each  discriminant  function 
(combination  of  correlations)  whose  weight  was  more  than  0.1  times 
that  of  the  maximum  weighted  function  was  retained  on  each  pass. 


Mi  thin  the  selected  di serin  in ant  functions*  those  correlations  whose 
weight  was  more  than  *25  tines  the  highest  weighted  correlation  were 
retained*  The  selected  correlations  were  weighted  by  the  number  of 
discriminant  functions  remaining  in  the  classification  equation*  and 
summed  over  the  3  test  sets.  The  5  highest  weighted  correlations 
were  then  input  to  the  pattern  classifier.  If  'test-set* 
classification  for  a  given  interval  was  still  significant  at  p<.01* 
the  entire  procedure  was  repeated  with  the  least  significant 
correlation  removed  until  a  classification  function  incorporating  a 
minimum  set  of  3  or  4  'prominent  correlations'  was  produced. 

RESULTS 


Average  ERP  Descr iption 

The  average  ERP  waveforms  from  Ps  #6-9  (Fig.  4)  consisted  of  a 
posteriorly  maximum  negative  peak  (N163)  and  a  centr o-par ietally 
maximum  positive  peak  (P230)  in  both  tasks.  In  the  move  task  there 
were  parietally  maximum  positive  peaks  at  425  and  500  msec*  followed 
by  a  centrally  maximum*  left- later  a  Used  negative -going  slow 
potential  shift.  In  the  no-move  task  a  positive  peak  was  observed  at 
391  msec*  maximal  at  the  anterior  parietal  electrode  (aPz)*  another 
at  425  msec  and  a  third  at  530  msec*  both  maximal  at  the  midline 
parietal  electrode  (Pz).  Subtraction  ERPs  (Fig.  5)  showed  that  the 
P391  peak  in  the  infrequent  no-move  task  immediately  follows  a 
negative  peak  (N2)  at  240  msec*  and  thus  may  be  the  probability 
sensitive  F'3a  peak  (Squires*  et  al*  1977).  The  larger  amplitude  of 
F'425  in  the  move  task  may  be  due  to  the  atypical  experimental 
pa-,  adigm*  in  which  a  difficult  response  is  required  to  the  f reguent 
task-related  stimuli.  P530  in  the  infrequent  no-move  task  may 
correspond  to  the  P3b  peak  observed  in  go/no-go  paradigms  and  to 
infrequent  task-related  stimuli.  Peak  latencies*  the  corresponding 
NCP  analysis  intervals*  and  response  initiation  times  for  each  person 
are  given  in  Table  1. 

ANOVAs  and  t-tests  were  performed  for  the  P391  (F’3a)  peak  amplitude 
and  the  slope  of  the  immediately  succeeding  slow  negative  potential 
shift.  For  the  F’391  peak*  a  task  x  electrode  x  person  ANOVA  revealed 
a  significant  task  effect  <F(1*8)  =  29.0*  p«.001)  and  task  x 
electrode  interaction  <F(13»104)  =  2.9*  p<.005>*  but  no  electrode 
effect  <F(13*104)  *  1.2*  H.S.).  Correlated  t-tests  revealed 

significant  voltage  enhancements  in  the  no-move  task  for  all  but  the 
lateral  temporal  electrodes*  the  most  significant  effect  being  at  the 
midline  anterior  parietal  electrode  (aPz)  (p<.0005)  (Table  2).  When 
Bonferroni-cor rected  for  multiple  comparisons*  only  the  aPz*  Pz  and 
C4  electrodes  remained  significant  (t  =  4.35  for  p<.05>.  Mean 
amplitudes  across  persons  at  aF'z  were  .1  uV  and  2.3  uV  for  move  and 
no-move  tasks*  respectively. 

A  task  x  electrode  x  person  ANQVA  of  the  slope  of  a  straight  line 
fitted  to  the  slow  potential  shift  in  the  response  preparation  (RP> 
interval  revealed  a  significant  task  effect  <F(1*8)  =  5.6*  p<.05>» 
electrode  effect  <£(14*112)  *  1.9*  p<.05>»  and  task  x  electrode 
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interaction  (F(14»  112)  =  2.7*  p<.005).  Correlated  t-tests  showed 
signif icsntly  larger  move-task  slopes  for  9  electrodes  (Table  3)4 
The  most  significant  difference  ( p<  4  005)  was  at  the  C3  electrode  * 
where  the  eean  slope  values  were  .24  and  -450  for  move  and  no-move 
tasks*  respectively 4  When  Bonferr on i -corrected  for  multiple 
comparisons*  no  electrode  remained  significant  (t  =  4435  for  p<*05>. 

Linear  Analysis  of  Evoked  Correlations 

hean  evoked  correlation  values  over  persons  and  electrode  pairs  were* 
for  the  move  trials*  prestimulus  interval  =  464*  N1-P2  interval  = 

4 65*  P3a  interval  =  *  65  *  RP  interval  =  .  65  ♦  and  for  the  no-move 
trials*  prestimulus  =  *65*  N1-P2  =  *65*  P3a  =  *65*  and  RP  =  *64* 
t-tests  of  differences  in  single-trial  correlations  between  tasks 
were  performed  for  the  91  electrode-pair  correlations  (Table  4)*  When 
Bonf erroni-cor rected  for  multiple  comparisons  only  the  F7-T3  and 
F8-P2  pairs  in  the  RP  interval  reached  significance  (t=  3*58  for 
P<*05>*  Without  Bonferroni  correction*  correlations  significant  at 
p<*05  or  better  were  found  in  every  interval*  In  the  prestimulus 
interval  5  of  the  9  significant  electrode  pairs  included  the  Fz 
electrode*  In  the  N1-P2  interval  the  4  significant  pairs  all  included 
parietal  sites*  In  the  P3a  interval  the  6  significant  pairs  were 
f r onto-centr al *  with  the  exception  of  the  P4-C4  pair.  In  the  RP 
interval  the  25  significant  pairs  were  widely  distributed*  but  8 
included  Fz*  9  included  F8*  and  5  included  C3* 

Pattern  Recognition  Analysis  of  Single-Trial  Evoked  Correlations 

Pattern  recognition  analysis  revealed  patterns  of  difference  in 
evoked  correlation  which  increased  in  magnitude  in  each  successive 
interval.  The  principal  electrode  and  prominent  correlations  of  the 
most  significant  electrode  set  in  each  interval  are  shown  in  Figure 
6*  In  the  prestimulus  interval  there  was  a  weak  between-task 
difference  of  the  Fz  electrode  set  (p<*01)»  involving  higher 
prominent  correlations  of  Fz  with  P3  in  the  move  task  and  higher 
correlations  of  Fz  with  T3»  C3  and  C4  in  the  no-move  task* 

In  the  N1-P2  interval  the  distinguishing  significant  difference  was 
in  the  Pz  electrode  set  <p<*001)*  with  higher  correlations  of  Pz  with 
aCz*  T3  and  T4  in  the  move  task*  and  higher  correlations  of  Pz  with 
F7  in  the  no-move  task* 

In  the  P3a  interval  th§  most  significant  difference  was  in  the  P4 
electrode  set  (p<5  x  10  J)*  with  higher  correlations  of  P4  with  C4  in 
the  move  task*  and  higher  correlations  of  P4  with  aCz  and  aOz  in  the 
no-move  task.  At  the  p<*001  level  the  aOz  electrode  set  also 
distinguished  the  tasks. 

In  the  RP  interval  themost  significant  difference  was  in  the  C3 
electrode  set  (p<5  x  10  °)*  with  higher  correlations  of  C3  with  Fz 
and  aOz  in  the  move  task*  and  higher  correlations  of  C3  with  Pz  in 
the  no-move  task.  Four  other  electrode  sets  distinguished  the  tasks 
at  .lower  significance  levels:  C4  (p<l  x  10  J)»  F7  and  T3  <p<5  x 
10  >»  and  Pz  <p<.001). 


For  the  prestimulus  and  N1-P2  intervals  the  reduced  classification 
functions  required  4  "prominent  correlations’  to  achieve  significant 
classification?  while  in  the  P3a  and  RP  intervals  only  3  were  needed. 
Further?  significant  classification  (p<.05>  could  be  achieved  with 
just  the  first  ter*  (discr iminant  function)  of  the  reduced 
classification  equation  (Table  5). 

To  test  the  interperson  validity  of  the  results?  the  classification 
accuracies  of  the  classification  equations  for  the  P4  electrode  set 
in  the  P3a  interval  and  the  C3  set  in  the  RP  interval  were  assessed 
on  the  data  of  each  person  individually?  and  compared  with  the 
overall  classification  accuracy  (Table  6).  The  group  equations  were 
valid  for  7  of  the  9  people.  As  a  further  test?  the  entire  analysis 
was  performed  on  the  data  of  one  person  <255  trials  from  P  *7)  for 
the  P3a  interval.  The  P4  electrode  set_ggain  achieved  the  highest 
classification  accuracy  <59.4%.  p<5  x  10  ). 

DISCUSSION 

Neurophysiological  Significance  of  Task-Related  Evoked  Correlations 

In  theory?  a  task-related  difference  in  evoked  correlation  between 
two  scalp  electrodes  could  be  due  to  one  or  more  possible  causesi  1) 
functional  coordination  of  two  distinct  cortical  populations?  2) 
driving  by  a  third  cortical  or  subcortical  neural  area?  and  3) 
volume  conducted  activity  from  a  distant  generator.  While  it  is 
if  the  task-related  patterns  of  evoked  correlation  determined  by 
Neurocogniti ve  Pattern  (NCP)  analysis  reflect  functional  coordination 
between  cortical  (and  possibly  subcortical)  areas?  their  anatomical 
and  temporal  specificity  suggests  that  significant  aspects  of 
task-related  neural  processes  are  being  measured.  (A  preliminary  NCP 
Analysis  of  single  channel  signal  power  determined  significant?  but 
weaker?  between-task  patterns  of  difference.  Some  of  the  significant 
electrodes  corresponded  to  those  found  with  correlation  measures. 
These  results  will  be  reported  elsewhere.)  However?  the  significance 
of  waveshape  similarity  in  scalp-recorded  brain  potentials  will  not 
be  understood  until  further  studies  are  completed. 

NCP  Analysis ?  ERPs  and  Neur opsvchologv 

In  this  section  the  main  NCP  results  will  be  discussed  in  light  of 
previous  neuropsychological  and  electrophysio logical  (ERP )  findings ? 
showing  how  they  concur  with  and  elaborate  the  information  obtainable 
by  those  methods.  Psychological  interpretation  of  these  results  must 
be  considered  speculative?  since  the  processing  stages  involved  in 
the  task  are  not  definitively  known . 

The  magnitude  of  between-task  difference  increased  from  interval  to 
interval.  The  presence  of  a  small  significant  effect  in  the 
prestimulus  interval  might  be  the  result  of  a  weak  task-specific 
preparatory  set  generated  in  the  course  of  the  session  by  the 
ordering  of  move  and  no-move  trials.  The  locus  of  this  difference  in 
the  Fz  electrode  set  is  consistent  with  neuropsychological  and 
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electrophysio logical  (CNV )  findings  suggesting  involvement  of 
prefrontal  cortex  in  preparatory  activity  (Teuber*  1964#  Walter* 
1967#  Foster*  1980).  A  previous  NCR  study  (Gevins*  et  al*  1981)  also 
revealed  evidence  of  a  task-specific  preparatory  set  in  the  task-cued 
prestieulus  interval  preceding  numeric  and  spatial  judgments.  The 
prominent  correlations  of  Fz  with  T3*  C3»  C4  and  P3  in  the  present 
study  suggest  that  this  preparatory  activity  extends  beyond 
prefrontal  areas. 

In  the  N1-P2  interval*  correlations  of  the  Pz  electrode  set 
distinguished  move  and  no-move  tasks  at  p<.001.  Subtraction  ERPs 
revealed  an  enhancement  of  the  N2  peak  no-move  trials  in  6  of  the  9 
participants  (792  of  the  total  data  set)  (Fig.  5).  Its  mean  latency 
of  240  msec .  placed  it  near  the  center  of  the  N1-P2  analysis 
interval*  and  its  amplitude  was  maximal  (1.7  uv)  at  Pz.  Thus  the 
bet ween- task  correlation  differences  in  this  interval  may  be  related 
to  N2.  Although  an  amplitude  increase  in  the  N2  peak  in  no-go  trials 
of  a  go/no-go  paradigm  with  equiprobable  conditions  has  been  reported 
(Simson*  et  al*  1977)*  N2  has  usually  been  reported  to  be  sensitive 
to  infrequent  changes  in  gross  stimulus  properties  or  patterns 
(Naatanen*  et  al*  1980).  However*  in  the  present  study*  stimuli  were 
equivalent  between  conditions  in  all  respects*  save  that  in  no-move 
trials  the  arrow  pointed  directly  at  the  target  in  various 
randomly-ordered  configurations.  The  N2  effect  at  240  msec  suggests 
that  a  no-move  configuration  has  been  identified  by  that  time*  and 
that  N2  may  reflect  a  more  subtle  process  than  the  detection  of  a 
gross  'mismatch'  in  stimulus  characteristics*  as  indicated  by  other 
recent  studies  (Ritter*  et  al*  1982).  The  prominent  correlations  of 
Pz  with  T3*  F7»  aCz*  and  T4  suggest  that  these  processes  are  not 
confined  to  the  parietal  area. 

In  the  P3a  interval  (which  was  centered  on  the  P3a  peak  and 
overlapped  a  portion  of  the  F3b  peakJgthe  right  parietal  (P4)  locus 
of  correlation  differences  (p<5  x  10  )  provides  novel  evidence  for 

the  lateralization  of  neural  processes  related  to  these  late  positive 
ERP  peaks .  Although  on  the  basis  of  lesion  evidence*  the  right 
parietal  cortex  is  known  to  be  necessary  for  such  spatial  judgments* 
the  late  positive  ERP  peaks  have  not  been  found  to  vary  in 
lateralization  according  to  type  of  cognitive  task  (Donchin*  et  al* 
1977).  J.  Desmedt  (1977)  reported  a  relative  right-sided 
lateralization  in  the  ERP  in  a  spatial  somatosensory-motor  task*  but 
the  effect  was  general  and  was  not  present  in  the  P3  peak*  nor  was 
its  scalp  distribution  determined .  A  previous  NCR  study  (Gevins *  et 
•1*  1981)  demonstrated  lateralized  temporc-par ietal  evoked 

correlation  differences  between  numeric  snd  spatial  judgments  in  the 
interval  centered  on  the  P3a  peak  at  340  msec.*  but  the  interval 
centered  on  the  P3b  peak  at  450  msec,  exhibited  bilateral 
between-task  differences  from  frontal*  central*  and  parietal 
electrodes.  In  the  present  study*  the  between-task  differences  in 
correlations  of  the  right  parietal  electrode  with  central  and 
occipital  electrodes  is  in  accord  with  neuropsychological 
expectations*  as  is  the  somewhat  weaker  effect  in  the  aOz  electrode 
set.  The  lateralized  NCR  finding  is  in  contrast  with  the  anterior 
midline  parietal  (aPz)  locus  of  maximal  amplitude  difference  of  the 


P3a  ERP  peak 


In  the  response  preparation  <RP)  interval*  centered  135  msec  after 
the  P3a  interval  center point »  the  focus  of  between-task  difference 
shifted  to  the  left  central  (C3)  electrode  set  <p<5  x  10  6)* 
involving  higher  correlations  of  C3  with  Fz  and  aOz  in  the  move  task 
and  with  Pz  in  the  no-move  task*  Since  the  RP  interval  overlapped 
EMG  onset  in  a  portion  of  the  set  of  love  trials  (average  response 
time  =  590  msec*  mean  S.D.  within  persons  =  240  msec.)*  the  RP 

interval  results  say  also  include  a  contribution  front  the  output 
activity  of  motor  cortex.  The  C4  *  F7*  and  T3  electrode  sets*  which 
differed  at  lower  significance  levels*  may  also  reflect  movement 
preparation  and  initiation*  since  the  presumed  generators  of 
voluntary  finger  movements  are  buried  in  the  lateral  bank  of  the 
central  sulcus  and  their  scalp  projection  may  be  diffuse.  The  less 
significant  difference  in  the  Pz  electrode  set  may  reflect  concurrent 
processes  related  to  P3b. 


Rapidly  Shifting  Lateralization 


The  rapid  (135  msec)  shift  in  side  and  site  of  lateralization  from 
the  P3a  to  the  RP  interval  may  help  clarify  the  controversy 
surrounding  the  existence  of  lateralization  of  brain  potentials  in 
different  types  of  cognitive  activity.  Although  various 
'verbal-analytic*  and  'spatial*  tasks  lasting  one  minute  or  more  have 
been  associated  with  relative  left  and  right  hemisphere  activity*  it 
is  not  clear  whether  this  is  due  to  cognitive  activity*  or  to 
stimulus*  motor*  or  arousal-related  aspects  of  the  tasks  (Donchin*  et 
al*  1977*  Gevins  and  Schaffer*  1980*  Gevins*  et  al*  1980*  Gevins* 
1983ab).  In  an  earlier  study  (Gevins*  et  al*  1979abc>*  we  first 
found  prominent  spatial  differences*  including  lateralized  patterning 
of  EEG  spectra*  between  one  minute  linguistic  and  spatial  tasks 
(reading  and  writing*  Koh 1 s  Block  Design  and  mental  cube 
reconstruction).  However*  no  spatial  differences  in  EEG  spectra  were 
found  between  similar  15  second  tasks  which  were  more  controlled  for 


other-than-cogni ti ve  factors.  Since  heterogeneous  tasks  composed  of 
many  component  operations  cannot  be  clearly  resolved  into  serial 
processes*  our  subsequent  study  (Gevins*  et  al*  1981)  refined  the 
approach.  It  used  short  (less  than  1  second)  visuomotor  tasks 

differing  only  in  type  of  judgment  (numeric  and  spatial)*  employed 
175-msec  analysis  intervals  based  on  person-specific  ERP 
measurements*  and  used  measures  of  between-channel  correlations  in 
single  trials  as  features  for  NCP  Analysis.  That  study  revealed  that 
even  split-second  judgments  involve  a  complex*  rapidly  shifting 
mosaic  of  task-related  evoked  correlation  patterns  involving  many 
electrodes  over  both  hemispheres.  Thus*  simplistic  views  of 
neurocogni tive  processing  may  be  the  result  of  inadequate  temporal 
resolution  of  rapidly  changing  neural  activity. 


The  present  study  confirmed  this  by  comparing  move  and  no-move 
variants  of  the  same  spatial  task.  The  results  suggest  that  the  tasks 
involve  split-second  changes  in  the  relative  localization  and 


lateralization  of  neural  activity*  A  dramatic  switching  of  the  foci 
of  patterns  of  evoked  correlations  is  seen  as  the  stimulus  is 
anticipated »  perceived *  judged *  end  a  response  executed*  These 
rapidly  shifting  patterns  are  consistent  with  network  models  of 
higher  cognitive  functions  (Luria*  19 77*  Arbib  and  Caplan*  1979* 
Zurif  I960*  Mesulam*  1981*  and  Gevins*  1981*  1983b) «  It  should  be 
understood  that  the  simplicity  of  the  patterns  reported  (Figure  6)  is 
due  to  the  fact  that  only  the  most  significant  results  were 
diagrammed*  The  inclusion  of  results  at  lower  significance  levels 
would  create  more  complex  patterns*  particularly  in  the  RP  interval. 
Further*  in  a  separate  within-task  analysis*  where  each  post-st imulus 
interval  was  compared  with  its  prestimulus  interval*  it  was  evident 
that  within-task  differences  were  complex  and  increased  in  magnitude 
and  anatomic  distribution  from  interval  to  interval.  This  is 
consistent  with  a  within-task  inter  latency  analysis  reported 
previously  (Gevins*  et  al*  1981)* 


Although  the  classification  accuracies  of  the  overall  (multiperson ) 
classification  equations  assessed  on  the  data  of  the  individual 
participants  varied  appreciably  (Table  6)*  the  existence  of  some 
invariant  task-related  patterns  in  7  of  the  9  persons  was  confirmed. 
The  fact  that  the  significant  difference  between  tasks  was  also  found 
at  the  PA  electrode  set  in  the  P3a  interval  when  the  data  of 
one-person  was  subjected  to  NCP  analysis  also  supports  the  inference 
of  patterns  which  are  invariant  across  people*  Moreover*  a 
nonparametr ic  randomization  test  performed  on  the  individual 
classification  accuracies  of  the  two  groups  of  P's  (#1-5  and  *6-9) 
confirmed  that  the  classification  equations  did  not  significantly 
differ  between  the  two  groups* 


l±  N££  Antlyti>  mifyJL? 

Analytic  methodology  is  a  critical  factor  in  determining  the 
precision  and  relevance  of  results  in  brain  potential  studies.  NCP 
analysis  uses  modern  signal  processing  and  pattern  recognition 
technologies  to  distinguish  spatially  and  temporally  overlapping 
task-r elated  brain  potential  patterns*  It  builds  on  the  vast  body  of 
ERP  research  by  using  the  average  ERP  to  determine  person-specific 
time  intervals  during  which  successive  stages  of  task-related 
processing  may  be  assumed  to  occur.  It  then  searches  the 
single-trial*  multichannel  brain  potential  data  with  a  mathematical 
pattern  classification  algorithm  to  extract  spatial  patterns  which 
distinguish  the  two  conditions  of  an  experiment*  As  with  other 
advanced  approaches  (reviewed  in  HcGillem*  et  al*  1981  and  Gevins 
1980)*  it  has  the  potential  to  reveal  information  not  obtainable  from 
averaged  waveforms*  Further  studies  will  determine  whether  NCP 
analysis  produces  results  meaningful  enough  to  justify  the  large 
amount  of  computation  required. 


A  full  comparison  of  NCR  analysis  with  linear  multivariate  methods  is 
beyond  the  scope  of  this  paper*  Two  linear  tests  were  performed  to 
give  some  indication  of  the  differences  between  methodst  post-hoc 
task  x  electrode-pair  ANOVAs  on  selected  variables*  and  the 
Bortf erroni-cor r ected  t-tests  on  the  full  set  of  single-trial 
correlations*  The  ANOVAs  were  limited  to  the  10  correlations  of  the 
most  significant  electrode  sets  determined  NCR  analysis*  the  P4  set 
in  the  R3a  interval  and  the  C3  set  in  the  RR  interval*  Only  the 
electrode-pair  effect  reached  significance  <F ( 14  *72 )  *  57.9*  p«. 001 
and  F<14*72)  *  48.6*  p<<*001»  respectively).  There  was  no 

significant  task  main  effect  or  task  x  electrode-pair  interaction. 
This  result  and  the  results  of  the  t-tests  (Table  4>  suggest  that  the 
variable  subset  selection  and  the  nonlinear*  distribution-independent 
properties  of  the  NCR  Analysis  were  both  important.  This  is 
consistent  with  two  previous  studies  where  this  type  of  mathematical 
pattern  recognition  proved  more  effective  than  ANOVA  and  stepwise 
linear  discriminant  analysis  (Gevins*  et  al*  1979a*  Lieb*  et  al* 
1981).  Although  the  Bonf err oni-corr ected  t-tests  were  significant 
for  only  two  electrode  pairs  in  one  interval*  at  uncorrected 
significance  levels  <p<.05  or  better)*  the  significant  electrode 
pairs  did  show  a  slight  similarity  to  the  NCR  results.  Of  the 

significant  Fz  pairs  in  the  prestimulus  interval*  3  are  identical  to 
the  prominent  correlations  determined  by  NCR  Analysis  (Fz-C3*  Fz-C4 
and  Fz-T3 ) »  and  the  frontal  distribution  of  significant  pairs  accords 
with  the  distinguishing  Fz  electrode  set  in  the  NCR  results.  For  the 
N1-P2  and  P3a  intervals*  however*  only  the  T4-Pz  electrode  pair  in 
the  former  interval  and  the  P4-C4  pair  in  the  latter  correspond  to 
prominent  evoked  correlations  of  the  NCR  analysis.  In  the  RP 
interval  the  t-tests  were  focused  on  the  frontal  areas  and  included 
only  two  significant  pairs  from  the  NCR  results  (C3-Fz  and  C3-F*.)* 

Ir.  its  present  form*  NCR  Analysis  seems  able  to  extract  patterns  of 
task -related  evoked  differences  from  the  obscuring  effects  of  volume 
conduction  and  background  EEG.  Further  research  is  being  conducted 
using  measures  of  interchannel  timing  and  single  channel  power  in 
paradigms  involving  manipulation  of  modality  and  responding  hand. 
These  studies  may  help  elucidate  the  significance  of  inter-electrode 
evoked  correlations  accompanying  neur ocogniti ve  processes. 
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LEGENDS 


Figure  1  -  Examples  of  stimuli  for  move  and  no-move  trials*  Arrow 
originated  at  center  screen?  its  direction  and  the  location  of  the 
target  changed  randomly  across  trials*  The  labels  'Hove*  and 
•No-Move*  did  not  appear  in  the  actual  stimuli* 

Figure  2A  -  Electrode  montage* 

Figure  2B  -  91  pairwise  correlations  were  computed  between  the  15 
electrodes  * 

Figure  2C  -  Anatomical  constraints*  The  correlations  of  a  principal 
electrode  was  measured  with  10  other  electrodes.  The  aOz  electrode 
set  is  shown. 

F igur e  3  -  The  major  peaks  of  the  average  event-related  potential 

(ERP)  and  Neurocognitive  Pattern  (NCP)  Analysis  intervals  determined 
from  them*  This  illustration  is  an  average  of  the  data  from  the  last 
four  persons  in  the  study i  in  practice *  the  peaks  and  analysis 
intervals  were  determined  separately  for  each  person. 

Figure  4a  -  ERPs  for  Move  trials  <610  trials  from  P's  #6-9). 

Figure  4b  -  ERPs  for  No-Move  trials  (604  trials  from  P's  *6-9), 

F igure  §  -  Subtraction  ERP's  (No-Move  minus  Hover  6  P's)  showing  the 
negative  (N2)  peak  at  240  msec. 

Figure  6  -  Between-task  NCP  results  obtained  from  single  trial  evoked 
correlations.  The  most  significantly  differing  electrode  set  and  its 
prominent  correlations  are  shown  in  each  interval. 

Figure  7a  -  Average  right  parietal  ERP  of  those  Move  trials  correctly 
classified  by  the  NCP  analysis  in  both  the  P3a  and  RP  intervals  using 
correlation  measures  (195  trials  from  4  people). 

Figure  7b  -  Average  ERP  of  correctly  classified  No-Move  trials.  P391 
(P3a )  and  P530  <P3b)  peaks  are  larger  in  the  correctly  classified 
No-Move  trials  (193  trials  from  4  people). 

Figure  7c  -  Average  ERP  of  incorrectly  classified*  but  behBviorally 
correct*  Move  trials  <122  trials  from  4  people). 

Figure  7d  -  Average  ERP  of  incorrectly  classified*  but  behaviorally 
correct*  No-Move  trials.  P3a  is  absent  and  P3b  is  smaller*  thus 
resembling  the  correct  Move  ERP  <121  trials  from  4  people). 

Table  i  -  Number  of  trials*  ERP  peak  latencies*  centerpoints  of  the 
NCP  single  trial  correlation  analysis  intervals*  and  average  response 
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initiation  latency  (EMG  onset )  for  each  of  the  9  participants . 


Table  2  -  Averaged  P3a  peak  amplitude  (in  micro-volts)  and  correlated 
t-tests  <df  =  9). 

Table  3  -  Response  Preparation  < RP )  interval  *  averaged  slope  of  a 

straight  line  fitted  to  slow  negative  potential  shift  and  correlated 
t-tests  (df=9). 

Table  4  -  t-tests  of  correlations  for  the  nine  participants  (1612 

trials*  839  Move*  773  No-Move).  Only  those  channel  pairs  showing  a 
significant  uncorrected  t-value  are  listed*  (p<*05  =  1.96*  p<*01  = 
2.57*  p<«001  »  3*29.  *Bonf er r oni-corr ected  t-value  of  3.58  =  p<.05.) 

Table  5  -  Simplified*  single  discriminant  function  classification 

equation .  G(f)  =1  for  f>0*  else  G(f)  =0*  (X/Y)  is  the  standardized* 
Fisher's  z’  transformed  correlation  value  of  the  X-Y  electrode  pair. 
Individual  trials  whose  classification  function  G(f)  =  1  were 
assigned  to  the  no-move  class*  those  whose  G(f)  =  0  to  the  move 
class . 

T able  6  -  Classification  accuracy  for  the  P3a  and  RP  intervals  for 
each  of  the  9  participants  using  the  equations  derived  from  the  whole 
group . 


0  Trials  ERP  peaks  (msec) 


Table 
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*3a 
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■ 

53.2 

51.7 

55.1 

52.5 

58.7 

51.5 

54.4 

55.1 

HP 


62.8  64.6 


47.0  43.9  64.2  58.7  52.0  1  $8.8 1  60.2  155.6 


500  msec. 


(610  Trials) 


Figure  4. 


Identical  Trials  (Also  sponsored  fey  the  Air  Force  Office 
Scientific  Research) 

In  order  to  exaaine  patterns  used  by  the  pattern  recognition  algorithm 
to  define  the  eove  and  no-aove  trials*  the  classification  assigned  by 
the  algorithe  to  each  trial  of  the  testing  data  was  noted*  In  all 
cases*  the  data  were  behaviorally  correct*  Trials  for  which 
classification  was  correct  for  both  P3a  and  RP  intervals  were  called 
correct*  those  with  incorrect  classification  for  both  intervals  were 
called  incorrect*  This  was  done  for  both  eove  and  no-aove  conditions* 
resulting  in  four  classes*  (a)  correct  eove*  (b)  correct  no-eove*  (c) 
incorrect  no-eove*  and  (d)  incorrect  eove*  Unfiltered  ERPs  were 
foreed  for  each  class  for  the  data  of  the  last  4  people  in  the  study 
(Figure  1). 

The  eain  difference  between  correctly  classified  eove  and  no-eove  ERPs 
was  the  positive  P3a  and  P3b  peaks  at  approxieately  365  and  530  esec 
post-stieulus*  respectively*  Coeparing  Figure  lc  with  Figure  lb*  the 
incorrect  no-eove  ERP  is  seen  to  lack  a  P3a  peak  and  have  a  sealler 
P3b  peak*  thus  reseebling  the  correct  eove  ERP*  The  incorrectly 
classified  eove  trials  (Figure  Id)  have  a  eore  distinct  P3b  peak  than 
the  correctly  classified  eove  trials  (Figure  la)*  thus  reseebling  the 
correctly  classified  no-eove  ERP* 

Another  obvious  difference  between  correctly  and  incorrectly 
classified  ERP's*  both  eove  and  no-eove*  was  the  strong  pre-stieulus 
alpha  'train*  in  incorrectly  classified  ERPs*  This  dissieilar ity  is 
clearly  seen  in  alpha  band-pass  filtered  averages  (Figure  2)»  In  both 
the  correct  and  incorrect  eove  conditions  there  are  alpha  band  ERPs 
which  occur  at  the  sane  post-stieulus  tiee  (in  phase)*  In  the 
incorrectly  classified  wavefore  the  pre-stieulus  alpha  is  euch  larger 
than  in  the  correct*  and.is  phase  reversed*  The  incorrect  ERP  appears 
to  undergo  a  phase  adjusteent  prior  to  the  zero-crossing  at 
approxieately  90  esec  post-stieulus*  which  occurs  at  the  saee  tiee  in 
the  correctly  classified  trials*  and  is  followed  by  a  negative  peak  at 
160  esec  in  both*  This  peak  corresponds  to  the  N163  peak  in  the 
unfiltered  ERP*  This  could  reflect  a  tie'ng  process  which  regulates 
the  activity  of  sensory  cortex  in  preparation  for  incoeing  stieuli 
(the  old  idea  of  the  'neuronic  shutter*)*  These  alpha-band  filtered 
ERP's  are  also  clearly  different  in  the  P3a  and  RP  intervals  where  the 
classification  .  was  aade*  The  high  prestieulus  alpha  in  the 
incorrectly  classified  trials  aay  be  related  to  cognitive  state*  so 
that  incorrectly  classified  trials  are  qualitatively  different* 
perhaps  due  to  automatic  processing*  Alternatively*  incorrectly 
classified  trials  aay  be  those  with  a  particular  alpha  phase  at 
stiaulus  onset*  resulting  in  enhanced  suaaation  of  pre-stieulus  waves* 
and  difference  in  post  stieulus  activity*  These  possibilities  are 
being  further  investigated  since  the  results  show  that  different 
neural  patterns  eay  accoapany  the  saae  behavior* 
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b)  Correctly  classified  no-move  trials 


Figure  l  -  Average  ERPs  for  trials  which  were  correctly  and  incorrectly 
classified  by  the  NCP  analysis. 
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(317  Trials  Total,  8-15  Hr) 

Figure  2 


VI ♦  Computer  Svsteas  Development 


August  2 ?  1983  (34X06) 


During  the  current  period?  computing  facilities  have  been  expanded  by 
the  acquisition  of  used  Digital  PDP-11/60  and  PDP-11/45  computer 
systeas*  The  11/60  is  equipped  with  an  Able  aeaory  expansion  unit  and 
1*25  Hb  aeaory?  a  160  HB  Winchester  disk  drive?  a  75  ips  tape  drive? 
two  5  HB  cartridge  disks  and  a  16  line  terainal  aultiplexor*  The 
11/45  has  256  KB  aeaory?  a  1*5  HB  and  two  2«5  HB  cartridge  disks?  an 

8- line  terainal  aultiplexor  and  an  LPA-11  DHA  interface  with 
associated  aodules  for  64  channel  laboratory  data  collection  and  D/A 
operations*  Both  systeas  run  the  RSX11-H  V.4.0  operating  systea. 
SYSGENS  are  perforaed  in  the  laboratory*  Hultiuser  word  processing  is 
supported  using  the  Word  11  systea*  There  are  two  1200  baud  reaote 
lines* 

We  have  nearly  coapleted  reprograaaing  and  testing  the  aajor 
coaponents  of  the  signal  processing  subsysteas  of  the  ADIEEG  systea 
(see  Fig*  1)«  Functions  of  the  coaponents  have  been  expanded  and  a 
aajor  new  prograa  has  been  iapleaented  for  autoaated  trial  selection* 

A  prograa  has  been  written  to  transfer  7-track  PDP15  data  tapes  to  the 

9- track  PDP11  foraat*  This  data  translation  prograa?  DATC0P?  coaputes 
a  coaaon  average  reference*  DATC0P  is  designed  to  aaintain 
coapat ibi 1 ity  between  our  current  data  base  and  experiaental  data 
which  will  be  collected  with  our  new  systea*  The  aia  is  to  replace  as 
auch  of  the  aanual  recording  of  inforaation  as  possible  by  the 
incorporation  in  future  data-bases  of  autoaatic  docuaentation  of 
collection  activites?  special  situations  (e»g*  bad  channels)?  setup 
details?  and  cross-referenced  files* 

The  averaged  evoked-potential  package?  ADIERP  (consisting  of  ADIPIX? 
ADIGRAF?  and  ADIPLT ) ?  has  been  coapletely  rewritten.  Both  ADIPIX?  the 
prograa  which  perforas  averages?  and  ADIGRAF?  the  prograa  which 
produces  graphs?  take  advantage  of  available  virtual  aeaory  for  speed 
rather  than  using  disk  files  for  data  accuaulation.  Capacity  is  up  to 
55  channels  for  up  to  4  files  for  data  accuaulation?  and  up  to  55 
channels  for  up  to  4  events*  Events  are  selectable  for  each  task  type 
and  bad  channels  are  eliainated  for  each  trial*  The  systea  is 
flexibly  data-driven  with  regard  to  nuabers  of  channels  and  points  per 
record*  The  graphing  is  done  on  events  and  channels  chosen  by  the 

user?  up  to  15  files  aay  be  averaged  or  different  averages  aay  be 
subtracted?  a  coapatible  output  file  aay  be  created*  Graphing  aay  be 
done  iaaediately  or?  if  the  user  prefers?  written  to  a  plot  file  for 
later  graphing  by  ADIPLT.  A  faster  version  of  the  prograa  is  under 
developaent » 

ADID0T  has  been  converted  to  the  PDPU/60*  This  prograa  reads  the  raw 
data  files  and  produces  coaprehensive  observation  files  of  behavioral 
variables  describing  each  trial?  as  well  as  arousal  and  eye  aoveaent 
aeasures  derived  froa  the  electrophysiological  data* 

ADIFX  is  a  feature  extraction  prograa  which  operates  on  single-trial 
EEC  data  and  coaputes  specified  aeasureaents  (e.g*  single-channel 
power  or  correlations  between  channels)  which  are  output  to  be  used  as 
features  for  pattern  recognition*  The  prograa  has  been  extensively 
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revised  end  Modified  to  utilize  the  capabilities  of  the  POP  11/60 
computer*  It  has  been  iaproved  to  operate  on  different  events  within 
an  experimental  trial*  It  has  been  expanded  for  production  of  up  to 
1000  features  for  each  trial*  It  now  allows  interactive  dialog  for 
specif iciation  of  up  to  55  EEG  channels*  15  time  windows*  15  frequency 
filters  and  400  trials*  The  current  version  produces  Measurements  of 
power*  Measures  of  zero-lag  cross-correlation*  maximum  lagged 
covariance  and  lag  number  are  under  development*  A  faster  filter 
function  is  being  implemented* 

ADIMRGf  the  data  selection  and  merging  program*  now  allows  selection 
of  observations  either  by  serial  number  in  the  input  file  or  by 
original  period  number  in  the  raw  data  file*  This  allows  selection  by 
the  automatic  reading  of  standard  period  files  maintained  for  each  raw 
data  file*  A  separate  program*  ADINRK*  now  performs  the  data 
normalization  for  all  variables  within  each  participant  for  up  to  12 
participants  simultaneously*  using  virtual  memory  rather  than  disk 
files  to  accumulate  data* 

ADIS0RT  is  a  menu  driven  program  to  interactively  select  trials  from 
feature  files*  The  main  process*  called  a  'sort**  involves  selecting 
trials  by  adjusting  the  limits  on  specified  variables*  Creating  a 
sort  involves  specifiying  a  feature  file*  a  set  of  variables*  and  an 
observation  range  (or  period  list)  for  that  file  to  be  included  or 
deleted  from  the  sort*  The  program  has  the  capacity  for  dealing  with 
two  sorts*  Menu  commands  include*  interactive  trial  selection* 
t-tests  between  the  two  data  sorts  for  all  variables*  creation  of 
output  report  files*  and  creation  of  graphics  output* 

ADISAM*  the  pattern  recognition  program*  has  been  completely 
parametrized  for  ease  in  configuring  it  to  particular  applications 
(eg*  maxims  of  the  number  of  passes*  candidate  units  per  pass*  number 
of  units  selected  per  pass*  connections  per  candidate*  variables  per 
observation*  observations  per  input  file*  variables  per  design* 
designs  per  run*  It  has  improved  dialog  for  easier  use*  systematic 
rather  than  random  unit  generation  with  elimination  of  duplicates* 
option  to  suppress  reweighting  (initializing  each  pass)  for  certain 
kinds  of  studies*  improved  handling  of  unequal  numbers  of  samples  in 
the  two  classes*  optional  output  of  pattern  weights  and  pattern  losses 
to  enable  studies  of  classification  performance*  A  small  version  of 
it  will  run  on  the  11-45  and  a  larger  faster  version  on  the  11-60* 
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VII  -  Elimination  of  Extra-cerebral  Electrical  Contaminants 
in  Single-trial  Data 

A.  Pilot  Study  for  Huscle-Potential  (EHG)  F i Iter 

The  frontalis  and  temporalis  muscles  of  the  scalp  lie  directly  beneath 
potentially  important  recording  sites  of  the  lateral  frontal  and 
temporal  areas.  Their  electrical  activity  contaminates  brain 
potentials  at  these  locations  and  at  more  distant  sites.  Simple 
low-pass  filtering  is  inadequate  for  removing  these  contaminants  for 
two  reasons*  low-frequency  components  are  present  in  the  EMG 
potentials*  and  we  wish  to  analyze  brain  signals  up  to  100  Hz.  As  is 
the  case  with  eye-movements*  contractions  of  these  muscles  could  vary 
systematically  between  tasks  or  with  increasing  taskload.  A  pilot 
study  was  conducted  to  investigate  the  requirements  for  constructing  a 
digital  filter  to  separate  scalp  muscle  potentials  from  those 
generated  by  the  brain. 

He  found  that  closely-spaced  pairs  of  bipolar  electrodes  (about  0.75 
cm  apart)  are  preferentially  sensitive  to  near-field  activity*  and 
thus  pick  up  the  activity  of  muscle  motor  units  with  little 
contribution  from  brain  potentials.  These  bipolar  electrode  pairs 
might  be  used  as  detectors  of  muscle  activity  and  as  sources  of  data 
for  the  design  of  a  digital  EMG  filter  by  allowing  measurement  of  the 
morphology  and  topography  of  muscle  potentials. 

The  results  of  several  test  recordings  may  be  summarized:  1) 
temporalis  and  frontalis  muscles  are  quite  active*  especially  during 
cognitive  task  performance*  2)  there  is  great  variability  between 
persons  as  to  amount  of  baseline  muscle  activity  and  ability  to 
•quiet*  scalp  musculature  with  biofeedback*  3)  when  asked  to 
voluntarily  contract  temporalis  musculature  and  then  relax*  individual 
small  motor  units  can  remain  active  for  a  long  period  of  time*  4) 
unequivocal  muscle  spike  activity  seen  with  the  closely-spaced  bipolar 
electrodes  appears  similar  in  form  to  fast  brain-potential  activity 
seen  in  ordinary  •common-referenced*  scalp  recordings*  5)  the  muscle 
potential  field  is  quite  large  with  standard-spaced*  common-referenced 
electrodes*  but  is  usually  small  with  the  closely-spaced  bipolar 
electrodes*  and  6)  a  number  of  closely-spaced  bipolar  electrodes 
(4-16)  are  required  to  adequately  sample  the  activity  of  scalp 
muscles . 

In  another  series  of  recordings  fine  (26-gauge)  EEG  needle  electrodes 
were  employed.  When  placed  in  the  temporalis  and  frontalis  muscles  at 
spacings  of  less  than  1  cm  they  are  almost  entirely  sensitive  to 
near-field  EMG  activity.  Bipolar  needle  electrodes  may  be  used  to 
record  EMG  signals  while  a  mixture  of  EEG  and  EMG  is  simultaneously 
recorded  by  'common  referenced'  cup  electrodes  at  the  same  locations. 
These  dual  recordings  could  form  the  data-base  for  the  design  of  a 
digital  filter  for  removal  of  EMG  contamination  in  normal  recordings 
(ie.  without  direct  measurement  of  EMG  signals  by  needle  electrodes). 

Implementation  of  an  EMG  filter  has  been  postponed  due  to  the 
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B.  Proposed  Method  for  the  Reaoval  qf  Eye-aoveaent  Artifacts 
f roe  Sinole-tr ial  Data 


1 «  Introduction . 

A  nuaber  of  aethods  have  been  used  in  the  atteapt  to  reaove  the 
contaainat ion  caused  by  eye-aoveaents  froa  scalp-recorded  brain 
potentials  (Hillyard  and  Galaabos?  1970#  Girton  and  Kaaiya?  1973# 

Ver lager  ?  et  al?  1982#  Fortgens  and  De  Bruin?  1983#  Gratton#  et  al» 
1983)#  Of  these  aethods#  only  that  of  Gratton?  et  al?  takes  into 
account  the  different  topographies  of  the  electrical  potentials  due  to 
eye-aoveaents  and  blinks  (Overton  and  Shagass?  1969) *  These  aethods 
were  of  varying  effectiveness?  and  aost  iaportantly  froa  our  point  of 
view?  they  are  aiaed  at  reaoving  cuaulative  effects  of  eye-aoveaent 
artifacts  froa  enseables  of  trials?  not  froa  data  to  be  analyzed  as 
single  trials*  The  aethods  are  based  on  the. probability  distribution 
of  the  EEG  and  eye-aoveaent  potentials  using  the  first  aoaent  of  these 
distributions  -  the  averages*  It  seeas  likely  that  a  better  estiaate 
of  the  correction  factors  could  be  obtained  by  using  at  least  the 
second  aoaents  of  the  observations*  This  section  outlines  a  proposed 
aethod  for  using  second  order  inforaation  to  obtain  a  better  estiaate 
of  the  correction  factors  involved  by  ainiaizing  the  cross-correlation 
between  the  recorded  eye  aoveaents  and  the  corrected  EEG  on  a 
single-trial  basis  by  the  technique  of  instruaental  variables. 

The  potentials  generated  by  eye-aoveaents  and  blinks 
(electro-oculograa?  or  EOG)  is  traditionally  aeasured  froa  pairs  of 
electrodes  placed  on  the  skin  at  the  outer  canthi?  and  above  and  below 
the  orbit  of  one  eye.  These  record  the  potentials  due  to  horizontal 
(saccadic)  and  vertical  (priaarilly  blink)  aoveaents?  respectively. 
The  source  of  the  potentials  aeasured  in  the  EGG  is  priaarily  the 
CorneoFundal  Potential  (CFP)*  This  is  a  dc  potential  between  the 
cornea  and  the  fundus  (back)  of  the  eye*  This  causes  the  eye  to  act 
as  an  electrical  dipole*  In  the  case  of  vertical  or  horizontal  eye 
aoveaents?  it  is  the  rotation  of  this  dipole  which  produces  the 
aeasured  potential  changes*  In  the  case  of  eyeblinks?  the  eyelids 
alter  the  contours  of  the  potential  field  of  the  CFP  by  acting  as 
sliding  resistors  (Oster  &  Stern?  1980) .  For  exsaple?  extension  of 
the  lid  increases  the  conductance  between  the  dipole  and  the  recording 
electrodes.  This  indicates  that  a  different  aodel  for  propogation  of 
blinks  and  eye  rotations  should  be  used* 

2*  The  Model ♦  The  objective  is  to  obtain  an  optiaal  estiaate 
of  electrical  activity  originating  froa  the  brain  at  a  given  scalp 
electrode  (which  contains  both  brain  and  eye-aoveaent  potentials)  by 
using  a  concurrent  recording  of  EOG  potentials  froa  electrodes  placed 
near  the  eye*  This  is  depicted  scheaatically  in  Figure  1*  In  order 
to  siaplify  the  problea  at  the  outset?  the  assuaption  is  aade 
initially  that  the  systea  is  linear?  and  so  the  aodel  of  Figure  2a  is 
obtained*  Here?  the  three  observed  signals  are  the  horizontal  EOG 
(HEOG) ?  the  vertical  EOG  <VE0G>?  and  the  EOG-contaainated  EEG?  denoted 
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H.  »  x  t  and  H  respectively*  The  systee  is  Modeled  as  ratios  of  linear 
operators  Ax's  and  Bx's*  The  underlying  EEG  activity  is  denoted  as  R* 
and  the  contribution  to  the  Measured  EEG  signal  froe  the  EOG's  is 
denoted  Y» 

In  order  to  siaplify  the  eatheeatical  derivations*  the  systee  is 
recast  in  an  equivalent  fore  in  Figure  2b*  To  see  that  this  systee  is 
equivalent*  note  that  B  is  now  the  product  of  B^x  and  B^**  and  that 
the  A's  now  have  additional  roots  to  accoeodate  the  ‘extra*  roots 
introduced  into  each  branch  by  the  new  B* 

The  eethod  is  to  be  iepleaented  on  a  digital  coeputer*  so  it  is 
reasonable  to  represent  the  systee  in  state-space  fore*  In  this  way* 
a  vector  U  can  be  defined  as 

Ur=  Eu(t*0>  u(t— 1)  u< t“-2)  u  ( t*-n)D  (1) 

where  u(t)  denotes  the  signal  u  at  tiee  t»  and  n 
corresponds  to  the  estiaated  order  of  the  systee* 

Sieilarly*  an  operator  can  be  defined  as  a  vector 
of  polynoeial  coefficients  as  in 

D  ■  Cd,  d_  d_  ♦ ♦ «d  1  (2) 

l  z  3  n 

In  this  way*  the  operator  D  operating  on  the  signal  U 
is  represented  as 

UrD.  (3) 


Now  an  augeented  signal  vector  is  defined 

XT-  txj  )  xjl  (4) 

and  a  sieilar  augeented  coefficient  vector  is 
defined 

Ar-  CA^  |  a£* 

The  systee  now  can  be  represented  as  in  Figure  2c*  (Note  that  eore 
accurate  representation  is  that  of  Figure  2  d*  The  other  diagraes 
given  are  Merely  shorthand  for  this*  The  state  variable  generator 
depicted  here  is  a  eeeory  eleeent*  providing  values  for  x(t»-l>* 
x(t«-2>*  etc*)  Figure  2c  is  equivalent  to  Figure  2a*  but  is  sieply 
recast  to  sieplify  the  eatheeatical  Manipulation* 


Hll  Method  flf 


VlMtfrlff 


It  is  presueed  that  an  optieal  estieate  of  the  coefficients  of  the 
systee  depicted  in  Figure  2  can  be  obtained  by  einieizing  the 
cross-correlation  between  the  recorded  eye  eoveeents  and  the  estieated 
clean  EEC*  A  Method  for  operations  of  this  type  has  been  developed* 
end  is  called  the  Method  of  instrueental  variables* 


The  Method  assuees  an  t  priori  estieate  of  the  coefficients* 
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applied  in  a  recursive  Banner*  until  no  significant  change  is  eade  in 
the  estieate  of  the  coefficients* 

In  the  following*  D  will  denote  a  noise-free  estieate  of  the  quantity 
D*  and  D  will  denote  the  eeasured  quantity  D  (presumably  contaminated* 
or  noisy)* 

Now  referring  to  the  system  in  Figure  2* 

XrAB*,»  Yt  (6) 

or 

XtA-  -  YrB  -  0.  (7) 

At  this  point*  it  is  remarked  that  choice  of  one 

coefficient  in  either  A  or  B  is  arbitrary*  For  this  derivation* 

the  coefficient  b,  will  be  chosen  as 

b,  ■  1.  (8) 

Now  equation  (7)  can  be  written  as 

XtA  -  YjTBa«  y(t=0)  *  y^  (9) 

where 

Y^  •  C  y(t*-l)  y(t*-2)  •«•  y(t*-n)  3 

*  c  Yi  yj  3 

and 

tf-  C  bt  b4  «».  b^4l3  • 

Now  a  signal  vector  is  defined  as 
ST«  CXTI  -Y/|l  3 
and  a  coefficient  vector 
C  •  C  *  |  B*  (  c,„J. 
and  (9)  becomes 
STC  ■  y  . 


(10) 

(11) 

(12) 

(13) 

(14) 
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If  measurements  are  taken  repeatedly  now*  the  signal  vector  S  is 
transformed  into  a  signal  matrix  ESI  given  by 


(15) 


x. 

x»  ...  x.-y* 

♦  t  • 

-y~  T 

Xl 

x,  x^-y, 

*  •  • 

-y^  i 

T 

• 

♦ 

A 

ESI  - 

♦ 

♦ 

• 

♦ 

♦ 

♦ 

x* 

Xi*.  •••  xB<-yfcM 

•  •  « 

-y*.«i 

Now  (14)  becomes 

ESI*C  *  Y 

r 

X 

Observing  that 

the  signal  y 

is 

unava 

(16) 


measured  signal  w  is  substituted  into  the  equation  for  y  in  all 
places*  Since  w  is  noisy*  the  equation  (16)  is  no  longer  an  equality* 
Denote  the  difference  as  e*  and  (16)  becomes 

ESI*  C  -  Ht«  e7  (17) 

where  ESI  is  now  composed  of  the  measured  x's  and  the  noisy  outputs  w» 

Now  referring  to  Figure  3*  and  letting  A  and  B  denote  estimates  for  A 
and  Bt  observe  that  a  noise  free  estimate  of  Y  can  be  obtained  by 


Yr«  xTsr* 


(18) 


Now  note  that  the  estimate  for  the  EEG  (R)  is  given  by 

R  «  W  -  Y  (  &  *  (19) 

Letting  Y  replace  Y  in  the  signal  matrix  ESI *  we  obtain  the  noise  free 
estimate  of  the  signal  matrix*  ESI*  where 

ST«  C  Xrj  VI  1  3,  (20) 

Letting  C  represent  the  inital  estimate  for  C*  andAC  the  correction  to 
minimize  the  correlation  between  8  and  X* 

C  «  C  +AC  ,  (21) 


where 

AC  ■  (SST)”,S(HT-  3E)  (22) 

provides  the  optima^  estimate  for  C*  This  method  is  applied 
recursively*  letting  Ct  ■  C,  ♦  AC* 

This  method  relies  on  a  fairly  good  initial  estimate  of  the 
coefficient  vector  in  order  to  converge*  One  way  to  obtain  this  is  to  . 
use  a  least  squared  error  algorithm*  For  this* 

AC  -  <&S7  >“'  §(HT-  §tC).  (23) 


^  -  ■*»»  — t»  — ^  1  -^* •-  ***  - 
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This  aethod  attempts  to  ainiaize  the  residual*  R»  which  in  this  case 
is  not  what  is  desired  at  all*  since  R  corresponds  to  the  EEG  signal 
estiaate*  Also*  the  least  squared  error  algoritha  diverges  upon 

repeated  application*  (See  appendix  also) 

4.  toilMaii  af  aethod 

The  aethod  which  will  be  used  to  evaluate  these  results  is  suaaarized 
below* 

Deviation  froa  'true*  ERP! 

It  will'  be  assuaed  that  the  best  estiaate  of  the  ERP  is  obtained 
through  the  traditional  aethod  of  rejecting  trials  in  the  average 
which  had  eye  activity  above  a  low  baseline*  If  the  ERP  coaputed  with 
inclusion  of  corrected  trials  is  aore  siailar  to  this  true  ERP  than 
the  ERP  coaputed  with  inclusion  of  all  trials  (but  uncorrected)*  then 
the  aethod  is  valuable* 

Reduction  in  variance! 

Since  soae  of  the  variance  in  response  between  trials  is  due  to  eye 
aoveaent*  it  is  expected  that  reaoval  of  eye  aoveaent  potentials  froa 
the  EEG  would  reaove  soae  source  of  variance  between  trials. 
Therefore*  if  the  variance  betwaen  trials  is  decreased*  the  aethod  can 
be  assuaed  to  have  soae  success* 

5.  Prpfrltaf  with  Hu  aethod  «Q0  Points  gf  extension 

One  problea  with  the  aethod  is  that  a  good  guess  for  the  order  of  the 
systea  is  needed  prior  to  beginning  coaputation*  Underestiaation  of 
the  order  leads  to  exceptionally  poor  results*  and  overestiaation 
leads  to  inclusion  of  roots  that  do  not  exist*  The  foraer  is  evident 
aerely  froa  observation  of  estiaates  that  do  not  nearly  fit  the 
observations*  The  latter  is  evident  when  the  estiaation  places  poles 
very  close  to  zeros*  and  thus  produces  poles  with  very  little  residue. 
Mhen  underestiaation  is  suspected*  aerely  reapplying  the  technique 
with  higher  order  estiaation  is  enough  to  iaprove  the  result*  In  the 
case  of  overestiaation*  residues  ere  calculated  for  each  pole*  and 
those  falling  below  a  certain  threshold  are  rejected* 

The  assuaption  of  a  linear  systea  aay  be  incorrect*  This  is  a 
fundaaental  assuaption  allowing  this  technique  to  work*  however  there 
ere  aethods  by  which  non- linearities  of  a  certain  class  aay  be 
•odelled  and  estiaated*  Typical  block  diagraas  for  this  type  of 
systea  ere  shown  in  Figure  4. • 

There  is  soae  conteaination  of  the  EOC  by  EEC*  This  prevents  the 
signals  X  in  the  aodel  froa  being  coapletely  observed*  In  this  case* 
one  of  two  possibilities  for  correction  aay  be  used.  The  first*  and 
initially  preferable*  is  to  obtain  soae  aeasure  of  eye  aoveaent  that 
is  truly  unc antes inated  by  the  EEC.  Methods  exist  which  detect  aotion 
of  the  eyeball  using  light  reflected  off  the  cornea*  Since  this 
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Method  does  not  rely  on  electrical  potentials  Measured  fro*  the  skin* 
it  should  provide  a  direct  Measure  of  EOG  without  contaaination  by 
EEG«  The  second  Method  is  to  use  inforaation  regarding  the  spectral 
distribution  of  the  EEG  and  EOG*  and  apply  soae  fora  of  whitening 


filter  to  the  EOG  before  using  the  inforaation  in  the  signal  aatrix. 
This  Method  probably  will  not  prove  to  be  useful »  since  the  spectra  of 
the  EEG  and  EOG  are  very  siailar. 

The  voluae  of  data  is  iaaense.  A  typical  experiaent  Might  collect 
400*000  or  More  aeasureaents  per  EEG  channel*  and  so  in  its  aost  basic 
fora*  one  diaension  of  the  signal  aatrix  should  be  400*000*  Clearly* 
soae  Method  of  data  reduction  aust  be  eaployed  here*  Since  the  systea 
can  be  assuaed  to  be  fairly  stable  over  an  interaediate  period  of 
tiae*  an  estiaate  of  the  systea  can  be  aade*  and  then  that  estiaate 
used  to  siaply  process  the  EOG  data  and  subtract  it  froa  the  EEG 
Measured*  If  this  is  done*  it  would  seea  to  be  wise  to  periodically 
update  the  estiaate*  or  at  least  verify  that  it  is  still  approxiaately 
correct  * 
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Appendix  Least  squared  error  and  instr umental  variables . 

Given  a  system  in  which  noise-free  outputs  are  observable*  the  system* 
its  input  and  output*  can  be  represented  as 

ST(C  -AC')  *  f T  (1) 

A 

where  S*  C*  QC*  and  Y  are  as  defined  in  the  text* 

If  more  measurements  are  made  than  the  order  of  the  system*  then  it  is 
a  case  of  n  unknowns  with  n  +  m  equations*  If  the  system  is  perfect* 
this  produces  no  problem*  But  any  imperfections  in  measurement  or  in 
the  system  will  produce  results  which  are  inconsistant »  and  the  above 
equation  for  AC  will  be  unsolvable*  To  remedy  this*  as  error  vector 
is  defined  to  allow  for  the  inconsistancies 

f  -  s‘r(dO-<l*T-  (2> 


To  arrive  at  the  least  squared  error  estimate*  ETE  is  minimized  (with 
respect  to^C)* 

£££  =  o  . 

JAC  (3) 

(in  order  to  achieve  a  minimum.''  In  this  case* 


3  AC 


%  -  H 


dt  1 

<t(AC_V 


ti(AC) 


and  so 

/i  ffS)  ’ 

Setting  this  equal  to  0*  and  solving  f  or  &C ) 
AC  --  (S^ylsC^-SrC). 

This  is  the  solution  for  a  noise-free  system* 


(6) 

(7) 


The  situation*  however*  is  not  noise-free*  in  that 
the  observation  W  contains  noise*  and  the  signal 
matrix  5  as  well*  Putting  these  measurements  into 
the  calculation  leads  to  a  biased  estimate  of  &£ 

stL*c)-s'(ac)  c) 

-  w’.  6.T-  -StC  <8) 

Note  that  this  equation  is  equivalent  to  (1)* 

Rewriting  (8)« 


79 


All'll!  i  1?  I'M'/! 

5rUc)  ~  w7-  STc  -I  r^T-sT)(^t)-  e.T*  (!T-5T)  c] 

:  Wt-StCi[(St'St)(C^)  -£t]  1*0 

[(sT-ST)  has  terms  dependent  only  or«  the  noise  vector*  R»  and 
CC-* Ac)  :  c  is  the  true  value  of  the  coefficients  for  the 
proper  (AC.),  and  so  the  term  in  the  brackets  is  dependent  only  on  the 
noise  and  on  the  system  -  not  the  measurements  or  the  estimate.! 

Solving  now  for  Ac  as  if  the  measurements  were  noise  free* 

AC  =  ^wr-sTc)4[(s§'r)'s[(fs‘,-sT)c  <10) 

But  the  computed  value  for  Ac  would  not  include  the  term  £  ^  .Thus 
the  bias  of  this  estimate  for  Ac  is* 

Ei.s  =  *{(sST)',sCtsT-sT)c-itT]}'*  ° 

since  the  noisy  signal  vector  correlates  with  the  noise  R .  The 
technique  of  instrumental  variables^is  similar  to  the  above  approach* 
but  relies  on  an  estimate  of  V  »  'i  which  is  uncorrelated  with  the 
noise*  R. 

Now*  using  the  estimated  signal  matrix  S  * 

m  =  (si'Y‘3  (wT-STc).[(jrr?[(2---sT)c-e.-Q]  (12) 

where 

e ft -«•"]; ;  °- 


The  bias 


in 


the  estimate  is  therefore  removed. 


